GEN AI Engineer
Charlotte North Carolina
Duration- 12 Months
Must Have Technical/Functional Skills
o Bachelors or Masters degree in Data Science Computer Science MIS related field or equivalanet experience
o 10 yrs of experience designing and developing AI solution architecture to scale
o Proven Hands-on experience in GenAI Ops-Operationalizing LLM and RAG applications in production
o Strong hands-on experience with the Langchain framework
o Experience specifically with the Open AI API chat completions embeddingsetc
o Have a solid awareness on TensorRT and VLLM implementation.
o Strong proficiency in python and data Science libraries(NumPyPandasscikit-learnPyTorch/TensorFlow)
o Proven experience applying guardrails and observability to LLM or RAG-powered applications.
o Experience with LLMs as Judges and SMLs for evaluation (attributionadherence bias PII etc)
o Hands-on experience with OpenShift(or Kubernetes) for containerized AL workloads.
o Experience measuring and optimizing inference latency.
Roles & Responsibilities
o Implement Guardrails and observability across RAG and LLM applications
o Setup GenAI Ops workflows to continuously monitor inference latency throughput quality and safety metrics.
o Definetrackand analyze RAG guardrail metrics using LLMs as Judges and SMLs(e.g. attribution groundingprompt injectiontonePII leekage)
o Implement annotationstructured feedback loopsfine-tuning and alignment methods to calibrate judge models
o Use langchain to orchestrate guardrail checks manage prompt versioning and integrate judge model scoring workflows.
o Work with Openshift to deployscale and monitor containerized genAI services.
o Build observability dashboards and alerts(Grafana or equivalent) for AI reliability.
...Are you a friendly and quick-thinking individual who loves great food? Join our team as a Restaurant Team Member. You'll help create... ...Rancho Cucamonga, Pinwheel Pasta features a full-service restaurant, delivery, and curbside pick-up. Join the Pinwheel Pasta staff and work...