Interpreting Embedded Survey Outcomes – Different Surveys Report Different Results
Surveys of embedded developers to establish market parameters regarding RTOS use must be careful to avoid unintentional bias.
I have recently been contacted by senior executives from RTOS companies mentioning UBM’s survey of embedded developers that placed FreeRTOS as the most used RTOS for embedded use in 2011 (14% of respondents). FreeRTOS placed 3rd in the 2010 UBM survey. Year-over-year EMF data is at substantial odds with these findings.
EMF takes no position on how UBM conducts their survey or on their results. EMF data for the past two years have shown that FreeRTOS usage has garnered less than 1% of total developer responses. This encompasses over 1200 responding developers. This is a significantly lower response than the 14% reported by UBM. EMF has no idea of how this discrepancy came about. We stand by our data as our surveys and responses are restricted and carefully monitored. We make no judgment regarding UBM’s methods or results. We are responding to requests to report our findings.
In EMF’s 2011 Annual Survey of Embedded Developers, eleven thousand embedded developers were statistically selected and sent invitations to participate in the 2011 survey. Six hundred and fifty three developers responded to our invitation. PIN numbers were assigned to each request so that we could insure that only those invited participated in the survey – and that they could respond only once.
In 2011 developers reported using an in-house RTOS (20.1%), Android (19.3%), XPE (16.5%) and CE (15.9%). FreeRTOS was used by 0.9% of respondents. From our perspective, the suggestion that FreeRTOS use would exceed that of in-house, Android, XPE, CE, or VxWorks use is beyond any reasonable reality check.