Python / ML Developer

About Sharedpro - Sharedpro is an AI platform company building AI-native products on a shared foundation of computer vision, audio-ML, real-time inference, vector search, and GPU model serving. Our products include AutoPilot Interview, Emotions API, TrueFace, Emotion Quest, and Pediatric Developmental Screening. We're a small, fast-moving team where engineers take end-to-end ownership and ship real products every week. The Role - We are looking for a hands-on Python / ML Developer with 4–6 years of experience to build the ML core of our AI products: a live AI voice interviewer, a facial expression / emotion measurement API, communication-delivery scoring for interviews, and integrity / proctoring signals. You will own real-time ML pipelines end-to-end — from data preparation and model training to low-latency inference services running in production on our own GPU infrastructure. This is a hands-on individual-contributor role; you will work closely with the Technical Lead, product, and the frontend and backend teams. Prior experience in a startup or fast-moving product environment is strongly preferred What You'll Do -

• Build and maintain production ML services in Python using FastAPI — REST APIs, WebSockets, and async pipelines designed around real-time latency budgets.
• Develop real-time audio/speech pipelines: ASR with Whisper / faster-whisper, voice-activity detection (Silero VAD), prosody and speech features (praat-parselmouth, librosa), and TTS integration.
• Train, fine-tune, and evaluate computer-vision models with PyTorch — facial expression / emotion recognition, face detection with YOLOv8 / OpenCV / MediaPipe.
• Integrate LLMs into products: prompt engineering, structured outputs, and resilient provider handling across Groq, Mistral, and OpenAI-compatible endpoints (fallbacks, rate limits, cost and latency optimization).
• Build retrieval and memory layers: embeddings, vector search with Qdrant, semantic matching across sessions.
• Serve and optimize models on in-house GPU infrastructure — Triton Inference Server / vLLM, fp16, batching, and throughput/latency tuning.
• Design honest, evidence-based scoring: calibration, bias checks, and explainable signals; treat privacy and PII handling as first-class requirements.
• Write well-tested production code (pytest), add logging and monitoring, and take part in code reviews.
• Own features end-to-end: prototype → production → measurement → iteration. Must-Have
• 6 + years of strong hands-on Python development for production systems (not just notebooks or scripts).
• Solid FastAPI experience (or Flask / Django) — REST APIs, WebSockets, async programming, and concurrency.
• Hands-on ML with PyTorch (training and inference) and computer vision with OpenCV.
• Experience integrating LLM APIs (OpenAI-compatible endpoints) and practical prompt engineering.
• Audio/speech ML exposure — ASR (Whisper), VAD, audio feature extraction — or demonstrated ability to go deep quickly.
• SQL databases (PostgreSQL / MySQL) and comfort working on Linux servers.
• Docker, Git, and CI/CD experience.
• Testing discipline with pytest.
• Strong problem-solving, debugging, and communication skills.
• Startup or fast-moving product experience preferred. Good to Have
• Model serving: Triton Inference Server, vLLM, ONNX, or TensorRT; GPU inference optimization, CUDA.
• Vector databases (Qdrant), embeddings, and RAG pipelines.
• MediaPipe, YOLO (ultralytics), and face-analysis models.
• praat-parselmouth prosody analysis and speech-feature engineering.
• Responsible-AI practices: calibration, bias mitigation, explainability; awareness of EU AI Act / NYC LL144.
• Basic React / TypeScript for demo frontends; Streamlit or Gradio for internal tools.
• Kafka / RabbitMQ / Celery / Redis / Kubernetes.
• AWS / Azure / GCP. Why Sharedpro
• In-house GPU infrastructure — train, serve, and optimize your own models.
• Real-world AI problems: voice agents, emotion recognition, speech scoring, and proctoring — not toy projects.
• Small team with high ownership; ship real products every week.
• End-to-end responsibility from data to model to production service.
• Modern stack: PyTorch, Whisper, LLMs, Qdrant, Triton, FastAPI.
• Freedom to make meaningful technical decisions in a fast-moving startup environment.