Data Science UA is a service company with deep expertise in AI and Data Science. Our story began in 2016 with the first Data Science UA Conference in Kyiv, and since then we’ve built one of the largest AI communities in Europe.
About the role:
We are looking for a Software Engineer to the clients team, with a strong backend engineering background to build and operate production-grade AI services based on LLMs, retrieval systems, agents, and external AI APIs.
This is a software engineering role applied to AI systems. You will turn AI concepts and models into reliable product capabilities by building scalable services, APIs, RAG pipelines, agent workflows, evaluation infrastructure, integrations, and production guardrails.
Responsibilities:
– Design, develop, and maintain production-grade Python services for AI and LLM capabilities.
– Build scalable APIs using FastAPI and/or Django.
– Design asynchronous and event-driven processing with AsyncIO, Celery, Kafka, and related technologies.
– Integrate foundation models, LLM APIs, and third-party services.
– Build RAG pipelines, vector search, retrieval services, and context-management mechanisms.
– Develop agent workflows, tool integrations, structured outputs, and multi-step orchestration.
– Manage prompts, model configuration, and context logic as versioned and tested software artifacts.
– Build automated evaluation harnesses, regression tests, and CI quality gates.
– Implement model-provider abstraction, retries, fallbacks, caching, rate limiting, and graceful degradation.
– Optimize latency, throughput, token usage, infrastructure consumption, and cost.
– Implement logging, tracing, metrics, alerting, guardrails, and auditability.
– Investigate and resolve production incidents involving AI services.
– Write unit, integration, contract, and end-to-end tests.
– Produce technical documentation, architecture decisions, and operational runbooks.
– Participate in architecture reviews and mentor other engineers.
Requirements:
– 3+ years of backend engineering experience, including 2+ years with Python.
– Strong experience with FastAPI and/or Django, AsyncIO, Celery, Kafka, SQL, Docker, and Linux.
– Experience designing and operating APIs, microservices, and distributed systems.
– Strong testing practices, including unit, integration, and API testing.
– Hands-on experience building production applications with LLM APIs.
– Experience with RAG, embeddings, vector search, and vector databases.
– Experience with LangChain, LangGraph, LlamaIndex, or similar frameworks.
– Experience building agent workflows, tool-calling, and multi-step LLM applications.
– Experience with LLM evaluation, regression testing, monitoring, guardrails, and fallbacks.
– Understanding of latency, scalability, reliability, and cost optimisation.
– Experience with AWS or another major cloud platform.
– English: Intermediate+.
Will be a plus:
– Kubernetes and Terraform.
– DDD, Clean Architecture, or Hexagonal Architecture.
– Go, Scala, or TypeScript.
– MCP or similar integration protocols.
– AI observability platforms.
– ETL and data pipelines.
– Experience in advertising or marketing technology.
Know someone, who'd be a great fit for this role?
Submit your candidate via the referral program and receive a bonus for a successful recommendation!