Emsi Burning Glass Data: Volume & Intensity Changes

Emsi Burning Glass will now be implementing a new dataset within Analyst that includes the best of both Emsi and Burning Glass data collection and processing procedures. In the previous dataset we had limited ability to control the original sources, leading to sometimes having duplicate postings, or gig/spam jobs appearing within the products. 

For this reason, legacy Analyst users will likely see approximately a 22% reduction in the overall job posting counts nationally, this will of course vary depending on the filters the customer is using within their research.  For example, a customer in New York or Pennsylvania may see a reduction in overall postings of approximately 25% due to improved deduplication processes related to trucking and gig economy jobs, as well as better representation in healthcare, universities, and banking.

With the new dataset we will have full control of our source data, which begins at aggregation. We are constantly updating our source list and monitoring/enhancing existing robots, giving us the most up to date and relevant job postings data. For more information on this process please see our Data Collection and Processing Methodology and our Aggregation FAQ’s.

This change will also enhance the data collection process starting with source aggregation. Source sites are fully vetted, are analyzed for data applicability, data from these sources is collected in a timely manner for new postings. This means that fewer duplicates are collected upfront combined with an enhanced deduplication process, users will see a decrease in the posting intensity, by removing more of the “junk” postings that sometimes skew the posting counts within a valid search, for example postings that are duplicates of the same opening across multiple sources. For more detailed information on how the deduplication works please see our Deduplication FAQ.