Praca evaluation Warszawa. Znaleziono 274 ofert pracy.

Senior AI Engineer

Altura.io PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 8 dni temu

... and greenfield prototyping Model evaluation and multi-model strategy Production ... building internal AI platforms (evaluation harnesses, prompt version management systems) ... and risk constraints A repeatable evaluation and release process that prevents ...

QA Engineer

Andersen PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 10 dni temu

... adapted for AI workflows, including evaluation‑based testing, scenario testing, and ... issues with detailed repro steps, evaluation evidence, logs, and accuracy quality ... . Nice to have: - Exposure to evaluation frameworks (LangFuse evals, Ragas, TruLens, ...

Senior Data Scientist /AI Engineer (RL)

ACAISOFT POLAND Sp. z o.o. PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa, mazowieckie 12 dni temu

... learning (RL) environments and scalable evaluation systems that guide and shape ... through rigorous, real-world agent evaluation. Due to the client’s time ... , from business analysis, through project evaluation, to UI UX, Frontend, and ...

Software Engineer III - Agentic Evaluations and Quality

Google PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa, mazowieckie 13 dni temu

Software Engineer III - Agentic Evaluations and Quality Miejsce pracy: Warszawa ... (e.g., model deployment, model evaluation, optimization, data processing, debugging). Optional ...

AI Engineer - Gen AI & LLM & RAG

emagine Polska PL, , , warszawa, mazowieckie, Warsaw 4 dni temu

... including ingestion, retrieval tuning, and evaluation. Integrate AI workflows with existing ... from day one: automated tests, evaluation checks, monitoring telemetry, and performance ... build and maintain AI evaluation harnesses (golden sets, regression tests, ...

AI Engineer with Gen AI & LLM & RAG

emagine Polska PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... including ingestion, retrieval tuning, and evaluation. Integrate AI workflows with existing ... from day one: automated tests, evaluation checks, monitoring telemetry, and performance ... build and maintain AI evaluation harnesses (golden sets, regression tests, ...

AI Engineer

Chabre IT Services Sp. z.o.o PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... , including ingestion, indexing, and evaluation Integrate AI-driven workflows into ... or LangChain Automate testing, evaluation, and monitoring of AI systems, ... similar Strong knowledge of LLM evaluation techniques, hallucination mitigation, and guardrail ...

Senior AI Engineer Generative AI LLM Systems

cerebre PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... performance and cost, and implementing evaluation, monitoring, and testing frameworks that ... on correctness, traceability, and evaluation Demonstrated ability to take ownership ... or TensorFlow for model evaluation, fine-tuning, or experimentation Experience ...

Senior Research Engineer - Learning to Rank

Allegro PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... the right methods, to rigorous evaluation and production deployment. This role ... ML use cases Model development & evaluation: Train, evaluate, and experiment with applied ML models using reliable evaluation methods Applied ML research: Translate ...

Senior Data Scientist with NLP

Stermedia PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... observability frameworks (monitoring, tracing, logging, evaluation, guardrails) ● Deploy AI solutions using ... implementing agent observability (monitoring, tracing, evaluation frameworks) ● Knowledge of REST APIs ...

Senior AI NodeJS Engineer

Tooploox PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... concept through implementation to evaluation and production. Take ownership of ... new knowledge. Employ a pragmatic, evaluation-driven approach to adopting innovative ... and distillation. Familiarity with LLM evaluation. Experience with Model Context Protocol ( ...

AI Engineer GenAI Agentic Systems

DCG PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... ingestion, retrieval tuning, and evaluation Integrate AI workflows with existing ... day one: automated tests, evaluation checks, monitoring telemetry, and performance ... , retrieval strategies, grounding, and evaluation Experience with agentic frameworks and ...

Senior Research Engineer

Allegro PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... the right methods, to rigorous evaluation and production deployment. This role ... ML use cases Model development & evaluation: Train, evaluate, and experiment with applied ML models using reliable evaluation methods Applied ML research: Translate ...

QA and Performance Testing Engineering Lead

Link Group PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... cutting-edge requirements of GenAI evaluation. Core Responsibilities & Technical Expertise Strategic ... architectures. AI LLM Specialized Evaluation: Implement advanced metrics for model ... and AI agent workflows. AI Evaluation Suite: A comprehensive suite for ...

Senior AI Engineer

XTB PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... resilient, enterprise-grade systems where evaluation-driven development and full-stack ... services. Practical experience in implementing evaluation-driven development using frameworks like RAG-eval and agentic evaluations to measure reasoning and tool- ...

Data Scientist Generative AI

Lingaro PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... rerankers, query transformation, and evaluation frameworks for relevance and robustness. ... models, including guardrails, output evaluation and A B testing. Designing, ... , feature engineering, models evaluation, hypothesis testing and model deployment. ...

Fullstack Senior Data Scientist

TechTree PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... , rerankers, query transformation, and evaluation frameworks for relevance and robustness. ... code, and multimodal models, including evaluation and A B testing. Safety ... and hosted models, agentic frameworks, evaluation techniques — and run targeted PoCs ...

Fullstack Senior Data Scientist

Lingaro PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... , rerankers, query transformation, and evaluation frameworks for relevance and robustness. ... code, and multimodal models, including evaluation and A B testing. Implement ... and hosted models, agentic frameworks, evaluation techniques) and perform targeted PoCs ...

Gen AI ML Senior Engineer AWS Snowflake Databricks

Accenture PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... , system prompts, guardrails, and evaluation frameworks for LLM applications. Build ... , feature engineering, model training, evaluation, and deployment. Integrate ML LLM ... in prompt engineering, guardrails, evaluation frameworks, and building RAG pipelines ...

Engineering Manager - AI & GenAI

Netguru PL, 52.21519, 21.2453, warszawa, mazowieckie, Warszawa 4 dni temu

... pipelines, agent orchestration, tool use, evaluation frameworks. Set the bar for ... engineering, prompt engineering, and AI evaluation. Monitor team health: velocity, code ... systems (RAG, agents, fine-tuning, evaluation). Strong Python and or TypeScript ...