Backend Software Engineer — Data Platform & AI Data Products at Together AI

<h3><strong>About the Role</strong></h3> <p>You’ll join the Data Platform team, responsible for building the backend services and “data products” that power how data moves through the company. We create the core platform primitives — high-quality event streams, reliable access layers, and developer-friendly APIs/tools — so teams across the org can self-serve what they need and ship faster. You’ll contribute to backend services that create value from our company data, and help make our data platform more self-serve so product and engineering teams can easily create and operate event-driven architectures, publish/consume streams, define access models, and ship data products end-to-end. You’ll also work on LLM-adjacent services such as prompt categorization/taxonomy, enrichment, and metadata systems that turn raw telemetry into trusted, usable products — with mentorship and support from experienced engineers.</p> <p><strong>Responsibilities</strong></p> <ul> <li>Contribute to backend services that enhance the data platform’s capabilities (APIs, control planes, automation, governance).</li> <li>Help enable DIY workflows for teams across the company:</li> </ul> <ul> <li> <ul> <li>Define/publish events and schemas</li> <li>Create/consume streams and subscriptions</li> <li>Establish access models (authz, row/field-level controls where applicable)</li> <li>Manage dataset/catalog metadata, lineage, versioning, and retention</li> </ul> </li> </ul> <ul> <li>Contribute to end-to-end data products: ingestion → validation/quality → enrichment → serving (APIs/streams) → observability → adoption.</li> <li>Work on prompt categorization and enrichment services: taxonomy design, labeling workflows, classifier/rules integration, evaluation, drift/quality monitoring, and safe rollouts.</li> <li>Learn to own reliability: SLOs, alerting, performance/cost tuning, incident response, and postmortems.</li> <li>Partner cross-functionally with ML/LLM, infra, security, and product teams to define crisp contracts and deliver durable platform primitives.</li> </ul> <h3><strong>Requirements</strong></h3> <ul> <li>0–4 years building production or project-based backend systems (internships, coursework, and personal projects count).</li> <li>Solid fundamentals in at least one backend language (e.g., Go, Python, Java, Rust) and some exposure to API design (REST).</li> <li>Eagerness to own work end-to-end: design docs, implementation, testing, deployment, and iteration based on real usage.</li> <li>Strong engineering fundamentals: clean, maintainable code, thoughtful abstractions, and a desire to build systems that are easy to evolve.</li> <li>Basic data modeling and SQL skills, and some familiarity with at least one of:</li> </ul> <ul> <li> <ul> <li>Streaming/eventing (Kafka/PubSub/Kinesis, etc.)</li> <li>Workflow/compute (Airflow/Spark/Flink/Trino, etc.)</li> <li>OLTP/OLAP stores and data lakes (Postgres + warehouse/lake tech)</li> </ul> </li> </ul> <ul> <li>AI augmentation curiosity:</li> </ul> <ul> <li> <ul> <li>You’re curious about how engineers use AI/LLMs to build software faster and better (e.g., coding copilots, agentic workflows, retrieval/knowledge grounding), and you’re eager to apply this to your own work.</li> <li>You understand that AI tools can fail or create issues, and you’re thoughtful about when and how to apply them.</li> </ul> </li> </ul> <h2><span style="font-size: 12pt;"><strong>Nice to have</strong></span></h2> <ul> <li>Any exposure to self-serve platforms, developer tooling, or multi-tenant services.</li> <li>Coursework or projects involving LLM/AI products: prompt/response telemetry, eval datasets, embeddings/RAG metadata, model/tool traces, privacy-safe logging.</li> <li>Passion for good quality code, highly readable, SOLID principles, design patterns, Domain Driven Design.</li> <li>Awareness of security and governance basics: least-privilege access, auditability, data retention, PII handling.</li> </ul> <h3><strong>About Together AI</strong></h3> <p>Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.</p> <h3><strong>Compensation</strong></h3> <p>We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $120,000 - $170,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.</p> <h3><strong>Equal Opportunity</strong></h3> <p>Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.</p> <p>Please see our privacy policy at&nbsp;<a href="https://www.together.ai/privacy">https://www.together.ai/privacy</a>&nbsp;&nbsp;</p>