A recent article in VentureBeat highlights the steady evolution of Two Sigma’s data pipeline ecosystem, and how we use that ecosystem along every step of the investment process, from data ingestion to investment decision-making.
The most recent step in this evolution was the acquisition of an advanced software platform from London-based Hivemind Technologies. The platform uses automation and human intelligence to transform semistructured and unstructured data sources into high-quality, machine-readable datasets at scale.
Cleaner data and better research
“Hivemind provides us with a framework for inserting the various forms of labeling into unstructured data,” says Carter Page, Two Sigma’s head of data engineering, in the article. “It brings more automation and accuracy to the preparation and onboarding of data, to enable cleaner data and better research.”
This acquisition complements two other, related transactions Two Sigma has made in recent years: Crux and Liberty Source. “Hivemind is one of the pieces of our larger data pipeline ecosystem,” Two Sigma CTO Jeff Wecker states in the article, “with all of our tools working together as part of a single platform to move data efficiently through the computation and analysis that drives decision-making in our organization.”
“While we’ve been developing these capabilities over the last 20 years,” continues Wecker, “we still have much to do to get it right. We have recognized that the part of the data world that is most underserved is end-to-end pipelining. We want to eliminate all the friction from research to production.”
To learn more about Two Sigma’s data pipeline ecosystem, read the full VentureBeat article.
