AI agent for sterility monitoring in pharmaceutical manufacturing

Company

NDA

Industry

Pharmeceuticals

Country of the Company

EU

Type of Service

Development

Tasks

  • Develop advanced computer vision models to detect protocol violations in aseptic environments.
  • Build an AI agent to analyze visual input in real time, interpret events, and issue alerts based on risk levels.
  • Implement a centralized dashboard for event logging, reporting, and trend analysis.
  • Enable multi-channel notifications with escalation logic for unacknowledged alerts.
  • Ensure the system meets pharmaceutical industry compliance and integrates with the company’s existing infrastructure.

 

Challenges

  • The client operates under strict regulatory requirements and high safety standards. Maintaining false positive and false negative rates under 8.5% and 9.8%, respectively, was essential to avoid alert fatigue or missed violations.
  • Accurate labeling of complex actions across large video datasets was time-consuming but critical to model performance.
  • Cleanroom environments introduced challenges like reflections, inconsistent lighting, and occlusions, making reliable detection more difficult.
  • Continuous monitoring across multiple camera feeds generated significant data volumes that needed to be stored, retrieved, and audited efficiently.
  • Manual oversight was not scalable, and traditional systems lacked the responsiveness needed to actively reduce incidents or generate usable compliance data.

Solutions

  • The team annotated over 7,000 cleanroom images and used targeted data augmentation and synthetic generation to simulate real-world conditions: glare, shadows, occlusions.
  • Image processing pipelines were tuned to normalize lighting fluctuations before model inference, improving detection stability.
  • The AI agent used a configurable rules engine to evaluate combinations of detections and escalate based on predefined risk scenarios (e.g., lack of goggles near sterile zones).
  • Developed an automated logging mechanism that records all safety-related events, enabling detailed audit trails for regulatory reporting.
  • Each alert included timestamped, role-specific information and direct references to SOPs, helping staff act quickly and appropriately.

Outcomes

  • Deployed a real-time sterility monitoring system across the client’s manufacturing zones.
  • Enabled fast, accurate detection and escalation of non-compliant procedures, reducing human oversight burden.
  • Maintained target false alert rates, balancing safety and efficiency.
  • Provided traceable audit logs and incident reports to support internal QA and external regulatory inspections.
  • Built a scalable foundation for continuous model improvement and future expansion to additional compliance areas.

Technologies Used

Python

YOLO v8

NVIDIA DeepStream SDK

CCTV

OpenCV

PyTorch

PostgreSQL

Plotly Dash

FastAPI

Company

NDA

Industry

Pharmaceuticals

Country of the Company

EU

Type of Service

Development

Learn about our impact through case studies

AI-powered client engagement and personalization agent

Successfully deployed a secure and compliant AI agent that recommends content, manages schedules, and engages clients in personalized conversations via the fitness-tech platform.

AI agent for real-time price prediction and automated trading insights

Reduced manual intervention in forecasting and reporting workflows with an AI agent capable of handling real-time price predictions, executing analysis, and sending back KPI reports.

AI assistant for enhanced online learning experience

Digitized and structured all course materials from PDF-documents and videos based on defined business logic, reducing time spent searching by over 70%.

Low-latency container number recognition for automatic shipping

Achieved a 70% reduction in time spent on supply chain operations with low-latency OCR optimized for edge devices. Eliminated manual entry errors with a dual-validation mechanism.

AI platform for streamlined design compliance and reduced project risks

Developed a generative AI-powered interface for IBC and ASCE queries, enabled iterative refinement, integrated design standards, and optimized mobile/desktop usability.

Leading omniscreen advertising platform

Developed ML for OTT screen classification and TV channel recommendations, and empowered engineers to work with minimal supervision.