Ibis is a new Python data analysis framework with the goal of enabling data scientists and data engineers to be as productive working with big data as they are working with small and medium data today. In doing so, we will enable Python to become a true first-class language for Apache Hadoop, without compromises in functionality, usability, or performance. Having spent much of the last decade improving the usability of the single-node Python experience (with pandas and other projects), we are looking to achieve:
• 100% Python end-to-end user workflows
• Native hardware speeds for a broad set of use cases
• Full-fidelity data analysis without extractions or sampling
• Scalability for big data
• Integration with the existing Python data ecosystem (pandas, scikit-learn, NumPy, and so on) …
Ibis google

Advertisements