IntroductionRise to meet the challenge of solutioning the world’s problems. At IBM, work is more than a job - it’s a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you’ve never thought possible. Are you ready to lead in this new era of technology and solve some of the world’s most challenging problems? If so, lets talk.Your Role and ResponsibilitiesWe are looking for Data Scientist to work on dynamically evolving IBM watsonx.ai offering from Kraków (Poland) office in product area of Model Evaluation.In this position, you’ll be immersed in the forefront of the AI revolution. Your duties will include critically assessing generative AI models and processes/enhancements related to them, establishing quality benchmarks, and challenging models' capabilities.
Want more jobs like this?GetjobsinKrakow, Polanddelivered to your inbox every week.
Want more jobs like this?
GetjobsinKrakow, Polanddelivered to your inbox every week.
Get Jobs
Your role and responsibility will encompass:Critically assessing and pushing the boundaries of generative AI models and tuning of such models, focusing on LLM modelsEstablishing and upholding stringent quality benchmarksCollaborate with the research team to develop state-of-the-art NLP solutions utilizing LLM modelsA successful candidate for this role should demonstrate:An intrinsic motivation, coupled with an insatiable appetite for continuous learningProficiency in crafting and sustaining tools to amplify productivityRobust analytical capabilities and a keen problem-solving acumenA tenacity to assume responsibility, driving problems to their resolution and tasks to fruitionProficiency in collaborating seamlessly within diverse team dynamicsFor an overview of the product, see https://www.ibm.com/products/watsonx-aiRequired Technical and Professional ExpertiseProfessional experience in AI/ML model development and evaluation with solid foundation in linear algebra, statistics, and optimizationFamiliar with automated ML models evaluations techniques, including Large Language Models (LLMs)Familiar with advanced model training methodologies including prompt tuning and fine-tuning with foundational modelsProficient in Python, with experience in coding and debugging in Python and Jupyter NotebookDemonstrated ability to critically assess and challenge AI (including LLM) models to ensure optimal performanceFluent in written and spoken EnglishPreferred Technical and Professional ExpertiseExpertise & up-to-date knowledge of advances in Foundation Models area, focusing on Large Language and Multimodal ModelsDesign, develop NLP models to extract insights and information from unstructured dataBackground in developing and implementing test automation frameworks and strategiesExperience with cloud environments