Praca evaluation Wrocław. Znaleziono 110 ofert pracy.

Senior AI Engineer Generative AI LLM Systems

cerebre PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... performance and cost, and implementing evaluation, monitoring, and testing frameworks that ... on correctness, traceability, and evaluation Demonstrated ability to take ownership ... or TensorFlow for model evaluation, fine-tuning, or experimentation Experience ...

Senior Data Scientist with NLP

Stermedia PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... observability frameworks (monitoring, tracing, logging, evaluation, guardrails) ● Deploy AI solutions using ... implementing agent observability (monitoring, tracing, evaluation frameworks) ● Knowledge of REST APIs ...

AI Engineer

Billennium PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... multiple client environments. Model Performance, Evaluation & Safety Implement automated model evaluation loops; benchmark LLMs to improve ... , and robustness . Design and run evaluation suites using Evals, PromptGuard, DSPy , ...

QA and Performance Testing Engineering Lead

Link Group PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... cutting-edge requirements of GenAI evaluation. Core Responsibilities & Technical Expertise Strategic ... architectures. AI LLM Specialized Evaluation: Implement advanced metrics for model ... and AI agent workflows. AI Evaluation Suite: A comprehensive suite for ...

Senior AI Engineer

XTB PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... resilient, enterprise-grade systems where evaluation-driven development and full-stack ... services. Practical experience in implementing evaluation-driven development using frameworks like RAG-eval and agentic evaluations to measure reasoning and tool- ...

Senior AI NodeJS Engineer

Tooploox PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... concept through implementation to evaluation and production. Take ownership of ... new knowledge. Employ a pragmatic, evaluation-driven approach to adopting innovative ... and distillation. Familiarity with LLM evaluation. Experience with Model Context Protocol ( ...

Engineering Manager - AI & GenAI

Netguru PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... pipelines, agent orchestration, tool use, evaluation frameworks. Set the bar for ... engineering, prompt engineering, and AI evaluation. Monitor team health: velocity, code ... systems (RAG, agents, fine-tuning, evaluation). Strong Python and or TypeScript ...

Senior AI Engineer R&D

Grid Dynamics Poland PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... AWS using Kubernetes. ML Monitoring & Evaluation: Implement rigorous evaluation and monitoring processes to validate ... a plus Experience with LLM evaluation frameworks (LLM-as-Judge) and ...

ML LLM Ops Engineer

Calimala.ai PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 12 dni temu

... full lifecycle—from experimentation and evaluation to deployment, guardrails, monitoring, and ... with retrieval, prompt management, and evaluation loops. “We treat ML and ... LLM pipelines, build feedback and evaluation loops (including human-in-the- ...

Senior AI Engineer

SmartRecruiters Inc. PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 12 dni temu

... production - including model training, evaluation, optimization, and deployment Drive experimentation ... LLM fine-tuning, and model evaluation Strong proficiency with deep learning ... with data quality management, evaluation metrics, or observability in ML ...

AI Product Manager

Calimala.ai PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 14 dni temu

... focus on use-case design, evaluation, and adoption, you’ll help clients ... interaction patterns, success criteria, and evaluation approaches, and ensure AI features ... contribute meaningfully to design and evaluation discussions. At Calimala, we value ...

Senior AI Engineer Remote

Svitla Systems PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... , data flow control, workflow design, evaluation logic, service integration, performance optimization, ... , tool execution, workflow control, quality evaluation, and scaling strategy. Contribute to ...

AI Engineer – GenAI & Cloud f m x

Sii PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... actually useful: data quality, latency, evaluation, and deployment. You’ll work across ... else has to rewrite Build evaluation and monitoring pipelines: automated quality ...

Senior Data Scientist Machine Learning Engineer

Shelf PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... frequently Stand up robust training evaluation pipelines: dataset curation, labeling feedback ... : transformers, embeddings, prompt design, and evaluation; ability to choose and justify ...

GenAI Architect AI&Data

Accenture PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... , GCP) with full observability, automated evaluation pipelines, monitoring, cost governance, and ... understanding of LLMOps : model versioning, evaluation pipelines, prompt management, cost monitoring, ...

Senior AI ML Engineer

Svitla Systems PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... scoring. Own model lifecycle concerns: evaluation, monitoring, drift detection, retraining, and ... feature engineering, model training, and evaluation for real-world datasets. Experience ...

AI Agent Developer aka The Architect Data Scientist

Yosh.AI PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... tools for automatic testing, bulk evaluation, and bot management , ensuring our ... on how to script conversation evaluations. You’re fluent in English (C1). ...

Senior MLOps Engineer

Intellias PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... and define solution patterns and evaluation gates (standardized tools, routing, shared ... CD design for GenAI ML (evaluation gates, versioning, canary, rollback) and ...

RL Environments Engineer

Preference Model via XOR Inc. PL, 51.10789, 17.03854, wrocław, dolnośląskie, Wrocław 4 dni temu

... tasks for RL and or evaluations . Experience in high-stakes or ... systems experience: CI CD, monitoring, evaluation harnesses, MLOps , scalable pipelines. Systems ...

Senior Data Scientist/AI Engineer (Reinforcement Learning)

TeamQuest Sp. z o.o. Dolnośląskie, Wrocław, 15 dni temu

... - reward modeling, environmental dynamics,verifiability, evaluation, and agent interaction loops.Knowledge ... environments for large-scale agent evaluation and reinforcement learning experiments.Create ...