Life at Eclipse

Welcome to 2012 folks, its going to be a busy and exciting year. There will be a number of important new projects, programs and initiatives across the Eclipse community. When we’re done Eclipse and the Eclipse Foundation is going to be quite a different – and even more interesting – place. So in no particular order, here is a sampling of some of the big things I see coming.

• As of the Juno release, Eclipse 4 is going to be the base platform for the Eclipse ecosystem. This means that our download page will only have Eclipse 4.2-based packages. Eclipse 3.8 will also ship as part of the Juno release, but currently there are no 3.x releases planned after that. Although an enormous investment has gone into the backwards compatibility layer for Eclipse 4, it is obviously going to take testing and effort by the Eclipse projects and the many Eclipse adopters to migrate to Eclipse 4.2. So if you haven’t started testing with the Juno builds, now’s the time to start planning for it. Eclipse 4 is a complete re-write of the platform user interface, and brings a lot of value to the ecosystem, including a lot of improved APIs, more flexibility and a refreshed user interface. And its API is 100% binary compatible with the 3.x platform.
• The migration of the Eclipse community to git is going to be a significant event during 2012. Shutting off CVS in December will be a major milestone. And we are almost done getting the Gerritt code review tool up and running for all Eclipse projects. To make all of this happen has been a ton of work by the webmaster team, the IP team, and you, the community. We’re hoping that using git will make it easier for our community to experiment with, and contribute back to Eclipse projects.
• A Common Build Infrastructure for Eclipse projects is a new service we plan to provide for projects at Eclipse. It has long been a complaint that getting builds working and running reliably is one of the biggest PITAs in running a project. The goal of the CBI is to reduce that effort, and to provide a core hosted service on eclipse.org infrastructure that all of our projects can use. As part of the initial proof of concept, we’re tackling the toughest build of all: the Eclipse platform. Admittedly, CBI is going to take a lot of work, but we are actively recruiting for a full-time staff member to manage this, and to act as a resource for our project community. This is definitely one of the biggest and most exciting new services we’ve worked on for our committer community. So please get involved, and provide your feedback and your requirements.
• We will also be launching a new service for members – providing Long Term Support for Eclipse releases. There is a fundamental mismatch between the maintenance window for Eclipse releases and the enterprise products that are built and ship on top. Eclipse release trains at least offer SR1 (September) and SR2 (February) maintenance releases on a regular basis. But an SR2 eight months after a major release is small solace to anyone with a requirement to offer support or maintenance on a product or application for five or more years (as many organizations do).

  As we are rolling this out, it is important to note that the Foundation is not going to be providing support or maintenance directly. Rather, we will work to connect organizations seeking support for Eclipse software with those offering it in order to cultivate a vibrant ecosystem. To help service providers be more efficient and effective, the Eclipse Foundation will provide the infrastructure for the code repositories, bug trackers, build farms, test farms, software signing, intellectual property management, and governance for managing the projects. We will be the trusted organization doing the drudge-work so that others do not have to. In other words, in classic Eclipse style, the Foundation will be acting as an enabler for the ecosystem.

• Orion is going to ship its 1.0 release later in 2012. There is a ton of work still to do, but there is no doubt in my mind that Orion is an important new technology for the Eclipse community – a whole new tooling platform for the web, in the web.
• EclipseCon is moving to Reston, Virginia, just outside Washington, DC. We hope to attract a lot of new attendees from the East Coast. In addition to the new location, we’re also adding an entirely new co-conference: Agile ALM Connect
• And last but not least, we will be creating a number of new Industry Working Groups. IWGs such as Polarsys and M2M are going to be a large focus area for the Eclipse Foundation. But what is an IWG? Basically, they complement Eclipse open source projects with more support from the member companies that are interested in working on them and adopting them.

I see 2012 as a year of significant, and positive, change for the Eclipse community and the Eclipse Foundation. We are certainly not resting on our laurels! I encourage everyone to get involved and contribute to these new initiatives.

Blogosphere and twittersphere are both abuzz this week as a result of Mikeal Rogers’ “Apache Considered Harmful” post. I thought the article made a number of important points about how the software world is changing, and changing very rapidly. However, I think that follow-on articles such as “Has open source outgrown the Apache Way” are pushing the hypothesis a little too far. It’s one thing to point out the dynamism of GitHub, and the rise of social coding. But stretching that to the assertion that open source foundations no longer have a role is just wrong.

Disclaimer: I run an open source foundation, so obviously I have a vested interest in this debate.

First, I would like to point out that Eclipse is absolutely committed to moving to git as fast as we can get there. We’ve even announced a date by which we intend to shut down our previous standard SCM, CVS. At some point we also intend to discontinue Subversion support for Eclipse projects as well.

Many in the Eclipse community know that I was personally a skeptic about the value of adding git. I was worried that having three SCM systems at Eclipse was too many. In addition to the resources required to support three SCMs, this kind of variety can act as a barrier to entry for both contributors and adopters. If folks have to learn multiple SCMs to interact with Eclipse projects, that is a PITA for them. In short, I was resisting change.

Fortunately, there were many good folks within the Eclipse community that convinced me I was wrong. You know who you are. Thank you.

The argument that ultimately swayed me was that git brings a social dynamic to contribution that the other SCMs we used lack. Adopting git is a strategic attempt by the Eclipse Foundation at social engineering. If we can lower the barrier to contribution at Eclipse, then we will make our community stronger and more innovative. That is ultimately the reason why we’re doing this. This has required investments by our IT team, and as we adopt Gerrit we are modifying our processes for IP management as well. We know that you can both use git and do excellent IP management, because we are already doing exactly that.

Next up is to do more work with GitHub to make it even easier for the broader community to fork Eclipse projects and contribute code back. We are consciously embracing the whirlwind.

I would point out that the model we have at Eclipse where we have a professional staff and some resources at the Foundation makes this kind of change easier to do. Once we’ve made up our mind as a community to push in a new direction, we have the people and the resources to make it happen. We’re not always fast enough to please everyone, but we get there.

But is git and GitHub so powerful a force that the Eclipse Foundation should just roll over and die? I honestly don’t think so. There are some unique values that an open source foundation like Eclipse adds to the equation that are absolutely necessary.

The first thing to understand is that what we are trying to build at Eclipse are not simply open source projects, frameworks or code libraries. Our mission is to ship product-ready software platforms that major corporations and enterprises can safely use and distribute in their products. This involves a level of co-ordination and process that goes far beyond what you can do at GitHub.

A small sampling of the core value-add that happens within the Eclipse Foundation and its community would include:

• IP management. Although we often get criticized for being overly focused on the topic, nobody does IP management better than Eclipse. Which is a huge part of fulfilling our mission of delivering product-ready software platforms. Yes, it’s a lot of work, but it is absolutely a core value, and one not easily replicated.
• Predictability. The Eclipse community has shipped its major platform release on time to the day for eight years. Last year’s release was 46 MLOC, so we are talking about a non-trivial amount of code. The processes that we have in place to co-ordinate the activities and release engineering for 60+ projects absolutely require some amount of centralized support.
• Branding and community. The Eclipse brand means something to people. Millions of developers around the world use Eclipse or Eclipse-based products every day. They have confidence in the software and the community that delivers it. Looking inside the community, there is definitely a pride and a sense of community that comes with being part of Eclipse. Anyone who has ever been to an EclipseCon has seen this firsthand.
• Industry collaboration. Obviously GitHub has been wildly successful in fostering community-led open source. However, there are lots of instances where large and conservative corporations are looking at how to get involved in open source. In many cases, their business motivation is to collaborate with other industry players to create shared industry platforms. The kind of work that goes into facilitating these ventures goes far beyond picking a license and starting to hack some code. The processes that organizations like Eclipse and Apache bring to the table for project incubation, development processes, license management and IP contribution management are critical success factors.

At Eclipse we are trying to simultaneously embrace change, while delivering the core values and processes to fulfill our mission of delivering product-ready software platforms. I feel that overall we are doing a pretty good job, and offer more than enough unique value to sustain us for the very long term.

The last few weeks have seen two great articles discussing the openness and transparency of the Eclipse community. The two reports were completely independent of one another, but both highly valued the open and transparent data we make available about our projects, and the vendor-neutral governance model that helps sustain Eclipse.

The first was a blog post from Matt Aslett at the 451 Group that uses Eclipse to illustrate the strong corporate backing and involvement in open source, while also noting that “…individuals are prominent in many Eclipse projects as well”.

I was particularly happy to see Matt’s recognition of the great work Wayne Beaton has been doing in freshening up our project summary pages (example here) to make it even easier to find information about the past, present and future of each project at Eclipse.

Earlier this week, Vision Mobile published an EU-funded study that gave Eclipse very high marks for its openness. In fact, it rated the Eclipse community as the most open of the eight open source project communities evaluated. You can read a summary of the report on their blog, or download the full report for free in exchange for your email address. You can also read Florian Mueller’s excellent summary on his blog.

I waited to comment on the report until I had a chance to read and digest it. We were obviously very happy to have Eclipse #1, but were frankly surprised that it ranked Eclipse ahead of open source stalwarts such as Linux and Mozilla. As with all such analyses, the methodology determines the outcome. And although I disagree with the approach in a few places, generally I found it consistent and fair. In particular breaking down each community by: access to the code and transparency of decisions, transparency of development, control over the downstream use of the software, and community structure seems pretty reasonable.

I was particularly happy that Vision Mobile’s report also recognized the value of the project summary pages (example here) and of dash.eclipse.org in providing full and transparent information about the projects at Eclipse. The Eclipse Foundation staff and all of the projects put a lot of effort into making all of that valuable information easily available, and it is nice to see that hard work recognized.

We continue to see lots of interest in the Eclipse model of open source development from industry, as you can see from our recent automotive announcement. We truly believe that we have mastered the best practices for openly governed, vendor neutral open source. It is certainly nice to see that recognized in these articles.

I just got home from Germany after a whirlwind trip to join the Eclipse Democamps in Hamburg and Berlin. And now it’s time to head back already. Next week is the Open Forum in Stuttgart, and I have the great honour of joining an all star cast of keynotes including Dr. Willibert Schleuter (Audi), Harald Hönninger (Bosch) and Prof. Dr. Manfred Broy (Technical University Munich).

Open Forum is a new event that came about after successfully co-hosting the Eclipse Embedded Day and SPICE Days Conference in Stuttgart the last two years. The focus of the event is how open source organizational methods need to be adopted by enterprises. Enterprises which are today confronted by the twin challenges of ever-accelerating demands for innovation, and the fact that it is now largely software which is driving brand value and differentiation amongst consumers. Imagine the difficulty those challenges pose to companies which for nearly a century have prided themselves on mechanical and manufacturing excellence. Organizations like Eclipse offer them an interesting proof point that open source methods can be used to deliver high-quality, innovative software on a predictable schedule. As we just recently showed again when we shipped Indigo.

I am looking forward to this event, as it is well outside my normal open source comfort zone. It will be fascinating to talk with a community grappling with how to apply the lessons of open source to the next wave of innovation in industrial methods.