SAN FRANCISCO, CA--(Marketwired - Jul 15, 2015) - Mesosphere, creators of the Datacenter Operating System (DCOS) for managing cloud and datacenter resources at scale, today announced the launch of a Developer Program with a software development kit (SDK) and certification program for developers building distributed services for the new datacenter form factor. Full program details and enrollment details may be found at: https://mesosphere.com/developer-program
Empowering the Modern "Datacenter Developer"
Mesosphere is driving an emerging class of applications which are built from the start to run at full datacenter scale. These distributed systems, such as Hadoop, Kafka, Kubernetes, Spark and YARN are designed to scale across multiple servers -- they need to be highly automated, elastic and scalable because they are driving today's big data, web- and mobile-backends, and IoT applications at scale.
The demand for large-scale distributed systems is giving rise to a new type of mainstream developer -- the datacenter developer -- which has parallels with the rise of mobile developers around the iOS and Android operating systems. The new class of datacenter developer builds applications and services that for reasons of size and complexity have outgrown the "per server" static partitioning approach of the legacy datacenter stack.
Historically, developers had to build create distributed systems from scratch. Today, with the Mesosphere DCOS, developers can build directly for datacenter and cloud scale using DCOS primitives for networking, resource allocation, container orchestration, fault tolerance, package distribution and automated operation.
The Mesosphere developer program and SDK is designed to help developers leverage the Apache Mesos distributed systems kernel that was born at UC Berkeley's AMPlab. Mesos brings a resource scheduling model and "common services" (like any operating system kernel) that are specific to application resource consumption across multiple servers. Mesos powers some of the web's most highly trafficked Web and mobile applications like Twitter, Yelp, Airbnb, Groupon and Apple's Siri, among others.
"Today's enterprise applications are being driven by a new data center architecture found at companies like Facebook and Google. The new norm is a distributed computing environment defined by hyperscale server deployments, containerized workloads, and microservices provisioning," said Peter Levine, partner at Andreessen Horowitz. "Mesosphere's DCOS is the first operating system built specifically for the new data center and we expect it to give rise to a new class of datacenter developer in the same manner that iOS created the mobile developer."
An SDK for the Datacenter
The Mesosphere SDK and developer program make it possible for any developer to easily create services that are purpose-built to run at datacenter scale, tapping into the burgeoning community of enterprises deploying datacenter and cloud services built to run autonomously on very large numbers of machines with the Mesosphere DCOS.
By using the Mesosphere SDK, developers can take advantage of DCOS primitives for:
- Sophisticated container and Docker scheduling - Use the SDK to call into the API for requesting and accepting resource offers, then execute tasks in a highly-parallel manner, executing them inside of containers, including Docker containers.
- Elasticity - Use Mesosphere libraries and sample to code to bring high-elasticity to your service, allowing it to scale up and down on demand.
- Scalability - Rely on the underlying Mesos primitives to support your service running on thousands of hosts.
- High availability - Mesosphere libraries and sample code (the same code used in Marathon) provide the building blocks for a fault-tolerant and self-healing system with extremely high availability.
- Portability - All DCOS services are completely portable. They can be deployed with no code changes to any cluster running DCOS, whether in a public cloud (e.g., Amazon, Google, Microsoft) or a private datacenter, virtualized or on bare metal, by virtue of being written against the DCOS API.
- One-command deploy (on prem, on any major cloud) - The DCOS packaging system makes it easy to deploy any DCOS service with one-command simplicity. E.g., dcos package install {name of service} will deploy a service to any infrastructure with no code changes.
- Ease of development - The DCOS primitives make it fast and easy to develop a highly-complex distributed system, saving months of development effort and tens of thousands of lines of code that would be required to build a highly-available, fault-tolerant, elastic and scalable system from scratch.
- Multi-tenancy of services - DCOS pools and isolates multiple frameworks in a single cluster so your customer can easily try out your service on an existing resource pool, and run your service along others at higher utilization.
The SDK also includes:
- Documentation: Tutorials, specifications, design guides, API documentation, and code samples
- Reference Project: A comprehensive reference project (fully documented code) provides a template and guide to understand the inner workings of a Certified DCOS Service
- Local Dev Environment: A lightweight DCOS development environment that can be easily set up on a desktop or laptop machine
All members of the Mesosphere Developer Program have access to Mesosphere's developer support, including a custom Google Group for posting questions, answers, tips, tricks, comments and suggestions. Developer Program members also have access to a live Slack Channel where they can chat in real time with Mesosphere DCOS Service experts and other DCOS Service developers.
VIP Partners Program
Members of the Mesosphere Developer Program are able to apply for Mesosphere's VIP Partners program. VIP Partners get additional benefits, including a Partner Manager, VIP Developer Support, Certification Assistance, Automated Distribution, and Co-Marketing, among other benefits.
The VIP Partners Program is built to support all of the key ecosystem participants:
- Independent Software Vendors (ISVs) - ISVs use the Mesosphere Developer Program to adapt their applications and services to the DCOS. (For partner testimonials, please refer to the Supporting Quotes sheet, attached.)
- Security / storage / networking / "software infrastructure" players - Infrastructure services play a large role in meeting enterprise demands for running large-scale datacenter and cloud operations.
- Hardware providers - Makers of infrastructure hardware, from servers to microprocessors to networking equipment, will work with the Mesosphere Developer program to build adapters for the DCOS that expose their differentiated products and capabilities up through the software stack to the application and services developers.
- Cloud providers - Through the Mesosphere Developers Program, cloud providers can build adaptors and extensions that help the DCOS and DCOS services run uniquely well on their cloud.
- SI partners - System Integrators leverage the Mesosphere Developer Program and SDK to build custom DCOS services for customers, to
Cisco is an example of one of Mesosphere's VIP Partners. "Cisco is working with Mesosphere to accelerate the next generation of cloud computing," said Ken Owens, CTO of Cisco Cloud Services. "What's so exciting about working with the Mesosphere DCOS is that it is the first actual operating system that exposes common services across thousands of machines for algorithmically allocating and deallocating resources. By offering an SDK, Mesosphere is making it possible for vendors at all layers of the enterprise stack to write to common services that will accelerate the pace of enterprise adoption of large scale distributed services."
VIP Partners also get access to Mesosphere's comprehensive certification program. This is a rigorous set of best-practice criteria, technical requirements and support guarantees that ensure enterprise can run a partner's service in production and at scale. The certification process provides a trusted imprimatur to partner services, making it easier for buyers to purchase and implement in production.
Additional Resources
About Mesosphere
Mesosphere (Twitter: @Mesosphere) is building the datacenter operating system (DCOS) to help enterprises unlock the next generation of scale, efficiency and automation. The Mesosphere DCOS pools datacenter and compute resources, gives IT operators a much simpler administration model, and improves developer velocity with more modern abstractions and APIs for writing distributed systems. Backed by Andreessen Horowitz, Data Collective, Fuel Capital, Khosla Ventures and Kleiner Perkins Caufield & Byers, Mesosphere is headquartered in San Francisco with a second office in Hamburg, Germany.
QUOTE SHEET
ArangoDB
"As an early stage, venture-funded startup, our focus is on continuously innovating ArangoDB's functionality and growing our market share," said Claudius Weinberger, CEO and Founder of ArangoDB. "The Mesosphere SDK, the primitives in the Mesos kernel, and the DCOS extensions that allow for packaging and distribution are allowing us to expand our footprint rapidly. With DCOS, organizations are able to use and deploy our database in the cloud and on-prem, without us having to write and maintain all of that infrastructure code. Our partnership with Mesosphere gives us access to the market of distributed developers who are already highly leveraging Mesos and the DCOS."
Basho
"The need for distributed applications and distributed data services is causing major challenges for companies using traditional architectures," said John Kaiser, Director of Partners and Alliances at Basho. "By combining Basho's Riak with the Mesosphere Datacenter Operating System, we're able to deliver an easy-to-deploy platform for real time data processing, including back-ends for large scale data processing, web, mobile, and Internet-of-Things applications. The new abstractions provided by Mesosphere reduce the complexity of large-scale, distributed environments and let enterprise customers gain immediate value from the hottest applications and distributed technologies."
Concord
"At Concord, we're building a stateful stream processor that can handle mountains of data in real time," said Shinji Kim, Co-Founder and CEO of Concord, an early stage startup building a new data streaming processor on Mesos. "With Mesosphere's SDK we are able to build on a platform that handles all of operational mechanics and scheduling, letting us focus on delivering a more robust way of processing data. Moreover, Mesosphere's developer program gives us access to formal developer support and a growing community of users. For a young company like ours, this will be an exciting distribution channel for our product when we launch it."
Confluent
"Apache Kafka lets you build real-time stream data pipelines that handle gigabytes of event streaming data per second in a highly elastic way, and we're seeing Mesos and the Mesosphere DCOS at the forefront of innovation around how datacenter resources enable data flow in big data analytics stacks." said Neha Narkhede, Co-founder and Head of Engineering at Confluent. "What's so compelling about the DCOS is the promise of running Kafka alongside distributed datastores like MemSQL and Cassandra, and Spark for analytics -- in a datacenter operating system platform that includes single command installation and native functionality for deploying and scaling to clusters. These are the hardest devops challenges for running modern big data analytics stacks, and DCOS is creating a simplified adoption path that makes running these technologies in tandem a user-friendly experience similar to downloading and running applications on a laptop or mobile device."
Crate
"The Mesosphere DCOS is really the only distributed systems platform that allows an enterprise user to easily administer distributed applications on a cluster that auto-scales under load," said Christian Lutz, COO at Crate.IO. "The operating system analogy is appropriate in the sense that you just don't think about how applications consume resources on your personal computer, and that level of abstraction is now being brought to distributed applications in the datacenter. We think a lot of ISVs are going to be attracted to DCOS for the promise that enterprises that normally couldn't consider giving a time slice to play around with a new distributed application can now simply install it and try it. This is a game changer in the application distribution status quo for enterprise."
Datadog
"In the same way that containers have become synonymous with how distributed applications are packaged and shipped -- Mesos and the Mesosphere DCOS is becoming synonymous with orchestration of resources across clusters," said Alexis Le-Quoc, CTO at Datadog. "We're using the Mesosphere APIs to collect performance metrics and events in enterprise-scale container environments, running the DCOS. The Mesosphere SDK makes it very easy to build our integration and deploy our agents on all nodes so that we can provide the kind of comprehensive and real-time monitoring that our customers need in these highly distributed environments."
DataStax
"We're excited to work with partners like Mesosphere because Cassandra and Mesos are a great combination," said Matt Rollender, VP, Cloud Strategy at DataStax. "With the Mesosphere DCOS users can deploy a modern microservices applications and add DataStax Enterprise to the same cluster with one command. That data can then be easily flushed to Cassandra or DataStax Enterprise without having to worry about problems you would normally encounter with a traditional relational database. The Mesosphere DCOS SDK opens up opportunities to deepen the integration points between Mesos and Cassandra or DataStax Enterprise for distributed developers working with high data volumes."
Engine Yard
"We're seeing a lot of Mesos out there in the field today," said Gabriel Monroy, CTO at Engine Yard. "We see Mesosphere and the DCOS making the power of Apache Mesos more broadly available to the ecosystem of vendors tackling those problem areas and more, and this new SDK opening up some great opportunities around the promise of so-called developer 'self service' in solving some of distributed computing's hardest problems. The services that DCOS and Mesos offer for running large scale batch analytics and big data workloads are unparalleled. And nothing handles the combination of containerized workloads with non-containerized workloads better."
Hedvig
"Hedvig's distributed storage application, like any distributed application, needs to solve the problem of enabling customers to easily deploy the technology in microservices architectures with containerized workloads," said Avinash Lakshman, founder and CEO of Hedvig, and inventor of Apache Cassandra. "From a storage perspective, the trickiest detail is data persistence. This is a major strength of the DCOS. We believe that the DCOS approach to persisting data across containers and between clusters is optimal for the new generation of applications that requires a much more flexible underlying datastore."
MapR
"As the leader in production deployments for Hadoop, we see increasing demand for convergence of infrastructure between operational and analytics applications, eliminating idle resources and complex data pipelines," said Will Ochandarena, Director of Product Management, MapR Technologies. "We are excited to work together with Mesosphere to make this a reality, with DCOS providing resource scheduling and the MapR Data Platform providing reliable, persistent data services across different applications. With Apache Myriad, this solution will support the widest ecosystem, including native Mesos, YARN, and Docker applications."
MemSQL
"Mesosphere and MemSQL share a vision of easy deployments of distributed systems, and that's why we're excited to be working with Mesosphere's Developers' Program," said Eric Frenkiel, CEO and co-founder, MemSQL. "Developers can deploy MemSQL in under two minutes using the DCOS and then combine MemSQL with other technologies like Apache Kafka and Spark. DCOS is a new distribution channel for MemSQL, and we look forward to powering real-time applications on Mesosphere that need the in-memory speed and scale of MemSQL."
Project Calico (Metaswitch)
"As organizations move from a fairly static VM-based infrastructure to a containerized microservices application infrastructure, one of the challenges they will have to manage is the order of magnitude increase in the number of containers, each of which may be very short lived," said Alex Pollitt, Evangelist / Director of Engineering for Project Calico. "The Mesosphere team have been working hard to deliver the key technology pieces that allow companies deploying and building at scale to focus on the applications, not the new demands and pressures on how the underlying resources are orchestrated."
Typesafe
"Developers want tools that allow them to manage processes without stepping on themselves, and that's why we're excited to work with Mesosphere's developer program to distribute Spark on top of Mesosphere's DCOS," said Dean Wampler, Architect for Big Data Products and Services at Typesafe, who earlier this year announced commercial support for Apache Spark on the Mesosphere Datacenter Operating System. "Mesosphere's DCOS provides convenient tools for deploying applications, as well as managing and monitoring the cluster."