As a Generative AI Engineer on the ED&A team, you will design, develop, and deploy enterprise AI applications for internal stakeholders — primarily using Dataiku’s platform and associated tooling. You’ll work with large language models (LLMs) from third-party providers (OpenAI, Anthropic, AWS Bedrock, Azure, etc.), build full-stack web applications, and create specialized “Agents” (and corresponding “Agent Tools”) capable of executing complex tasks. Success in this role requires strong programming abilities (Python, SQL, HTML/CSS/JS), excellent communication skills, and a deep interest in operationalizing generative AI across the company.
Key Responsibilities
- Solution Development & Integration
- Design end-to-end Generative AI solutions on Dataiku’s platform (or Python-based frameworks where needed).
- Integrate and optimize third-party LLM APIs (OpenAI, Anthropic, AWS Bedrock, Azure), focusing on prompt engineering and orchestration (e.g., LangChain).
- Build and maintain robust data pipelines, ensuring AI applications are performant and secure.
Agent & Agent Tool Creation
- Develop and implement autonomous or semi-autonomous AI “Agents” that interact with multiple data sources and services.
- Design Agent Tools (e.g., data retrieval modules, decisioning logic, automated workflows) that Agents can leverage to fulfill complex tasks.
- Monitor Agent performance and iterate based on usage data, business feedback, and changing requirements.
Web Application Development
- Create front-end user interfaces (UI) for AI applications using HTML, CSS, and JavaScript—often within Dataiku’s webapps framework.
- Collaborate on UX design, ensuring internal stakeholders find solutions intuitive and responsive.
Collaboration & Governance
- Work closely with analytics and data engineering teams to maintain metadata on reference datasets for LLM consumption.
- Adhere to data governance, security, and regulatory compliance requirements for all GenAI solutions.
- Partner with stakeholders to identify opportunities for AI-driven process optimization and automation.
Continuous Learning & Thought Leadership
- Provide product feedback to the development team to improve the product.
- Stay current with industry trends, particularly around AI agent frameworks and LLM best practices (LangChain, prompt engineering, vector databases).
Qualifications
- Technical Proficiency
- Must have strong Python skills (including familiarity with typical data science libraries).
- Experience developing AI, ML, or analytics solutions in a production setting (generative AI/LLM experience is a plus but not strictly required).
- Web development fundamentals (HTML, CSS, JavaScript); experience with Dataiku webapps or similar frameworks a bonus.
- Familiarity with LangChain or similar LLM orchestration libraries is strongly preferred.
- Exposure to third-party LLMs (OpenAI, Anthropic, AWS Bedrock, Azure) or other NLP/AI APIs.
- Educational & Professional Background
- Bachelor’s or Master’s in Computer Science, Data Science, Engineering, or a related field; equivalent experience also considered.
- Demonstrated ability to integrate multiple technologies, optimize workflows, and deliver user-friendly AI solutions.
- Soft Skills
- Strong communication and presentation skills, capable of collaborating effectively with both technical and non-technical stakeholders.
- Problem-solving mindset with a passion for innovation and delivering measurable business value.
- Openness to learning new tools (e.g., Dataiku) and adapting to an evolving tech landscape.
Why Join Our Team?
- Work with Cutting-Edge Tech: You’ll gain hands-on experience with Dataiku’s platform, LangChain, and leading LLM providers.
- Impact & Visibility: Our GenAI solutions address critical business needs, offering high visibility and meaningful impact.
- Collaborative Environment: We prioritize teamwork, mentorship, and continuous learning—perfect for both experienced engineers and those just starting out.
- Career Growth: From contributing to technical roadmaps to presenting results to stakeholders, you’ll have countless opportunities to develop your skills and influence the company’s AI strategy.