Best Practices from Building a Machine Learning Bot for Halite
An overview of best practices derived from building a machine-learning based starter bot for Halite, Two Sigma's public artificial intelligence programming challenge.
Insights: python
Introducing Pandas UDFs for PySpark
A Two Sigma researcher introduces the Pandas UDFs feature in the upcoming Apache Spark 2.3 release, which substantially improves the performance and usability of user-defined functions (UDFs) in Python.
Improving Python and Spark Performance and Interoperability with Apache Arrow
Apache Arrow-based interconnection between various big data tools (SQL, UDFs, machine learning, big data frameworks, etc.) enables you to use them together seamlessly and efficiently,