Software Engineer - Data Platform - Remote - Dataiku
San Francisco, CA 94199
About the Job
At Dataiku, were not just adapting to the AI revolution, were leading it. Since our beginning in Paris in 2013, weve been pioneering the future of AI with a platform that makes data actionable and accessible. With over 1,000 teammates across 25 countries and backed by a renowned set of investors, were the architects of Everyday AI, enabling data experts and domain experts to work together to build AI into their daily operations, from advanced analytics to Generative AI.
Why Engineering at Dataiku?
Dataiku’s on-premise, cloud, or SaaS-deployed platform connects many data science technologies, and our technology stack reflects our commitment to quality and innovation. We integrate the best of data and AI tech, selecting tools that truly enhance our product. From the latest LLMs to our dedication to open source communities, youll work with a dynamic range of technologies and contribute to the collective knowledge of global tech innovators.
As enterprises worldwide become more and more invested in the cloud, Dataiku looks to expand its services and offerings to adapt to rapidly shifting customer needs. Dataiku brings together Large-scale data analytics and AI technologies into a unique and easy-to-use platform. It allows data scientists to process data with SQL databases, Spark, and Kubernetes with user-friendly visual interfaces or code.
To help us fulfill this mission, we are looking for a talented full-stack software engineer to work on the Data analytics part of Dataiku and other core features of the platform.
Our current technical stack is based on a mix of Java, Javascript and Python.
This position is either onsite from Paris, London, Berlin and Amsterdam or remote from these countries.
How you’ll make an impact:
(Note: this is a Software Engineer position, focused on developing Dataikus features and capabilities. We have separate positions open for Data Engineers, Data Scientist and Data Analyst)
The mission of the Self-service Analytics teams is to maintain and improve the core features of Dataiku that are dedicated to Business Analysts & Developers, such as:
- Data integration: this includes reading from and writing to Snowflake, BigQuery, Redshift, Azure Synapse, flat files on S3 (CSV, Parquet, Excel, …)
- Data preparation & transformation through graphical UI, code or ChatGPT-like inputs, using the latest processing engines: Spark on K8s, SQL with UDFs, Snowpark, etc.
- Data catalog with automated quality assessment
- Jupyter notebooks & SQL workbench
- Help and onboarding experience
- Automation & public REST APIs
Some expected outcomes for this role:
- Add new ways to clean up data using Large Language Models such as ChatGPT
- Optimize our layout engine to be able to render complex workflows of 1000 datasets faster
- Support new databases capabilities to read/write or process data faster
- Improve our help system to make it smarter
- Strengthen our git support, including automatic and graphical merge conflicts resolutions
- Add autocomplete to our SQL workbench supporting a wide range of databases
What you need to be successful:
- You have experience in software development and are interested in data processing
- You are "customer-oriented" you want to understand how the product is used and solve actual customer problems
- You know, Data science is 80% preparing data and 20% complaining about preparing data
- You are curious about working under the hood and want to learn how things are built
- You have firsthand experience (either professional or personal) in building a real product
- You dont hesitate to ask questions when you dont know, and treat your colleagues with respect, kindness, and honesty
What does the hiring process look like?
- Initial call with a member of our Technical Recruiting team
- Video call with an Engineering Team Lead
- Technical Assessment to show your skills (Home Test or Live Coding)
- Debrief of your Tech Assessment with Engineering Team member
- Final Interview with a VP Engineering #LI-Hybrid
What are you waiting for!
At Dataiku, youll be part of a journey to shape the ever-evolving world of AI. Were not just building a product; were crafting the future of AI. If youre ready to make a significant impact in a company that values innovation, collaboration, and your personal growth, we cant wait to welcome you to Dataiku!
Our practices are rooted in the idea that everyone should be treated with dignity, decency and fairness. Dataiku also believes that a diverse identity is a source of strength and allows us to optimize across the many dimensions that are needed for our success. Therefore, we are proud to be an equal opportunity employer. All employment practices are based on business needs, without regard to race, ethnicity, gender identity or expression, sexual orientation, religion, age, neurodiversity, disability status, citizenship, veteran status or any other aspect which makes an individual unique or protected by laws and regulations in the locations where we operate.