We’re building a new team called the Forward Deployed ML (FDML) team. Building on the core platform team’s developments, the FDML team will focus on project-specific adjustments and automations to meet customer and task-specific needs. Our goal is to customize and implement ML solutions for automating data annotation and quality checks. We’ll work closely with the delivery manager, using our machine learning and software skills to ensure efficient delivery on critical ML data annotation projects.
Location: Redwood City or San Francisco
Main Responsibilities
For this role, there would be a lot of interaction with the Ops team to understand their immediate needs and proposing/implementing innovative solutions to get them what they need built on top of our core platform. This includes rapid prototyping using LLMs, scripting, dashboarding, and data munging.
Required Qualifications
- Bachelor’s degree in Computer Science, Software Engineering, or a related field.
- 2-5 years of professional experience in software development, preferably with a focus on backend development and data-intensive applications.
- Proven track record of building, deploying, and maintaining APIs and microservices in production environments.
- Hands-on experience working with relational databases for complex data queries and schema design.
- Experience with developing and optimizing machine learning pipelines or integrating Large Language Model (LLM) inference systems into applications.
- Proficiency in FastAPI for API development.
- Expertise in Pandas and NumPy for data manipulation and analysis.
- Experience with containerization using Docker and Kubernetes
- Familiarity with OpenAI APIs or other LLM-related tools for AI/ML use cases.
Preferred Qualifications
- 7+ years of professional software engineering experience
- Experience at a startup
- Experience with LLM prompting, LLM evaluation, and LLM related frameworks.
- Familiarity with LLM inference pipelines and model serving frameworks (e.g., Hugging Face Transformers, Triton).
- Knowledge of non-relationaldatabases (e.g., MongoDB, Redis).
The salary range is $200,000.00 - $250,000.00.
