NewML Solution Architect JobotML Solution ArchitectBoston, MA$150,000–$250,000 / yearInformation collected and processed as part of your Jobot candidate profile, and any job applications, resumes, or other information you choose to submit is subject to Jobot's Privacy Policy, as well as the Jobot California Worker Privacy Notice and Jobot Notice Regarding Automated Employment Decision Tools which are available at jobot.com/legal. Responsibilities: Design, develop, and implement end-to-end cloud-based machine learning production pipelines (data exploration, sampling, training data generation, feature engineering, model building, and performance evaluation).
Senior Mechanical Engineer SymboticSenior Mechanical EngineerNorth Waltham, MAApplying next-gen technology, high-density storage and machine learning to solve today's complex distribution challenges, Symbotic enables companies to move goods with unmatched speed, agility, accuracy and efficiency. Cross-Functional Collaboration: Work closely with electrical, software, controls, manufacturing, and quality engineering teams to ensure seamless integration and product success. .
NewAssociate Vice President of Financial Planning, Data, and Analysis Lesley UniversityAssociate Vice President of Financial Planning, Data, and AnalysisCambridge, MA$171,375–$194,744 / yearAt Lesley University we strive for a supportive and equitable environment where people -- regardless of race, ethnicity, color, sex, physical ability, religion, national origin or ancestry, age, neurodiversity, sexual orientation, gender identity or expression, genetic information, veteran or military status, membership in uniformed services, and all other categories protected by applicable state and federal laws -- can participate equally and fully as their true selves in all aspects of university life. In doing so, Lesley strives for a campus culture and community that fosters a true sense of belonging for all, provides opportunity for everyone to participate equally and fully in the Lesley experience, and helps to develop each individual's capacity to confidently and competently engage within and across difference.
Director of Product Management, AI - Remote MotiveDirector of Product Management, AI - RemoteBoston, MARemote$187,000–$260,000 / yearYou will work alongside a star team from engineering, data science, computer vision, research & design, marketing, operations, legal, sales & customer success in a fast-paced, rapidly growing, technology environment to build intelligent experiences to shift behavior and drive ROI-positive impact for customers. Motive serves more than 120,000 customers – from Fortune 500 enterprises to small businesses – across a wide range of industries, including transportation and logistics, construction, energy, field service, manufacturing, agriculture, food and beverage, retail, and the public sector.
NewCompliance Risk Analyst Epitec, IncCompliance Risk AnalystFramingham, MAHighlight risks associated with the use case and make the business owners aware of the risks and help those business owners respond to those risks. Partner with IT, Legal, Privacy, Cybersecurity, and AI Governance Committee to align governance requirements with delivery milestones and identify regulatory considerations the AI use cases pose to the organization.
NewData & AI Delivery Lead # 26-15965 US Tech Solutions, Inc.Data & AI Delivery Lead # 26-15965Cambridge, MAData initiatives liaison and partnering for R&D and Medical Serve as the main point of liaison between the Global Data & AI Division, R&D and Medical Business Domains and GDIT Business Partners for all data initiatives in Global Data & AI division scope, ensuring alignment with business priorities. Strategic Roadmap and Portfolio Management Collaborate with R&D, Medical, GDIT Business Partners, and the Global Data & AI functions to create data initiatives roadmaps and visions that address current and future business needs , balancing innovation and industrialization.
Senior Manager, Supply Chain Operations SymboticSenior Manager, Supply Chain OperationsMalden, MA$135,000–$185,900The ideal candidate is a disciplined, analytical leader who thrives in cross-functional environments, proactively identifies supplier and operational risks, strengthens controls, enhances transparency, and drives supplier performance to support complex, capital-intensive project timelines. The group oversees project planning, supply planning, material and inventory management, spares/RSPL procurement and logistics, ensuring materials and equipment are available when and where needed to support installation, commissioning, and ongoing site operations.
NewDirector, AI Engineer KPMGDirector, AI EngineerBoston, MADeep understanding of scaling AI-driven solutions, ethical AI, and MLOps practices for maintaining models; ability to bring industry consulting insights with a balance of technical and business acumen to deliver strategic, value-driven AI solutions; In-depth knowledge of AI orchestration and best practices. Proficient in architecting and implementing AI-powered workflow solutions using Microsoft, AWS, or Google Cloud services (For example: Foundry, Bedrock, Vertex AI), with capabilities in defining blueprints and technical requirements for scalable, automated systems with expertise in agentic AI and automation.
Senior Software Engineer, Agent Platform KlaviyoSenior Software Engineer, Agent PlatformBoston, MA$148,000–$222,000 / yearIn addition to base salary, our total compensation package may include participation in the company’s annual cash bonus plan, variable compensation (OTE) for sales and customer success roles, equity, sign-on payments, and a comprehensive range of health, welfare, and wellbeing benefits based on eligibility. We have a big opportunity to build state-of-the-art AI and machine learning technologies at Klaviyo to power our products and develop AI agents that can automatically create and execute marketing or customer experiences, strategies, and campaigns for any business.
NewRegional Sales Director, Midwest (Strategic) - Remote CriblRegional Sales Director, Midwest (Strategic) - RemoteBoston, MARemote$200,000–$215,000 / yearYour focus will be on attracting top talent, nurturing growth, and empowering your team to excel in both new logo acquisition and account expansion—consistently exceeding ambitious quarterly and annual goals. At Cribl, we partner with IT and Security teams at many of the world’s biggest enterprises, including half of the Fortune 100, to bridge the gap between AI ambition and infrastructure reality.
NewDirector, Google Cloud Security, Solution Architect KPMGDirector, Google Cloud Security, Solution ArchitectBoston, MAInnovate and evangelize next-generation security operations solutions by leveraging Google Cloud's advanced capabilities, including AI and machine learning within the Google SecOps platform; critically assess client security technology and processes, providing expert justification for migrating to and optimizing with Google Cloud native security solutions. Collaborate closely with KPMG and Google Cloud sales teams to develop and present compelling technical solutions, product demonstrations, and architectural designs focused on Google Cloud's security portfolio (e.g., Google SecOps SIEM and SOAR, Google Unified Security, Security Command Center).
NewMachine Learning Scientist I WayfairMachine Learning Scientist IBoston, MA$125,000–$145,000 / yearWe do this by leveraging our best assets, such as collaborating with leading nonprofit organizations, coordinating in-kind product donations, empowering our employees to get involved through paid volunteer time off programs, and encouraging our customers to donate. Professional coding expertise in languages like Python and R, proficiency in SQL, and experience with data visualization tools; skilled in using ML frameworks (TensorFlow, PyTorch) and implementing CI/CD, containerization, and version control best practices.
Machine Learning Engineer II / Senior Machine Learning Engineer I, Physical Sciences Lila SciencesMachine Learning Engineer II / Senior Machine Learning Engineer I, Physical SciencesCambridge, MassachusettsFull-time U.S. employees receive a comprehensive benefits program including medical, dental, and vision coverage; employer-paid life and disability insurance; flexible time off with generous company wide holidays; paid parental leave; an educational assistance program; commuter benefits, including bike share memberships for office based employees; and a company subsidized lunch program. This Machine Learning Engineer for the Physical Sciences team focuses on building and operating end-to-end, scalable machine learning workflows that solve a diversity scientific use cases in materials, chemistry and physical sciences.
Machine Learning / Reinforcement Learning Infrastructure Engineer EkaMachine Learning / Reinforcement Learning Infrastructure EngineerCambridge, MassachusettsCollaborate with Researchers: Partner with the research team to understand their needs, build infrastructure that supports cutting-edge methods, guide best practices for training at scale, and contribute to core JAX model and training code. Distributed Systems: Familiarity with distributed training, multi-host setups, data pipelines, and managing workloads on cloud platforms or orchestration systems (e.g., Kubernetes, SLURM, GCP, AWS).
Machine Learning Engineer II/ Senior Machine Learning Engineer I, Physical Sciences Lila Sciences IncMachine Learning Engineer II/ Senior Machine Learning Engineer I, Physical SciencesCambridge, MAWhat Youll Be BuildingDesign, implement, and maintain end‑to‑end ML pipelines (data ingestion, feature engineering, training, evaluation, deployment, monitoring).Productionize models and services with robust testing, observability, and documentation in collaboration with cross-functional software teams and build CI/CD workflows and automated evaluations to ensure safe, frequent releases. Your Impact at LilaThis Machine Learning Engineer for the Physical Sciences team focuses on building and operating end-to-end, scalable machine learning workflows that solve a diversity scientific use cases in materials, chemistry and physical sciences.
Machine Learning Scientist I - Early Careers Wayfair LLCMachine Learning Scientist I - Early CareersBoston, MA$125,000–$145,000 / yearProfessional coding expertise in languages like Python and R, proficiency in SQL, and experience with data visualization tools, skilled in using ML frameworks, TensorFlow, PyTorch, and implementing CICD containerization and version control best practices. With an in-house AB testing platform and rolling code deployments, our team can quickly and clearly see the impact that its work has on the company at large, and the algorithms you create will directly impact the customers experience.
Machine Learning / Reinforcement Learning Engineer EkaMachine Learning / Reinforcement Learning EngineerCambridge, MassachusettsData & Pipeline Engineering: Develop scalable data management pipelines for real and synthetic data; evaluate and select algorithms that maximize data efficiency and overall policy performance. Track Record: A history of publications in top-tier robotics or machine learning conferences, or a portfolio of projects providing strong practical evidence of expertise in the field.
Senior Software Machine Learning Engineer (Teradyne, North Reading, MA) Teradyne IncSenior Software Machine Learning Engineer (Teradyne, North Reading, MA)MA$133,900–$223,900 / yearDrive applied research and model innovation, explore and evaluate new architectures, algorithms, and training methodologies, and translate promising approaches into production systems. Lead end-to-end development of production ML systems: data ingestion and feature engineering, model architecture design, training pipelines, evaluation frameworks, and deployment.
NewStaff Machine Learning Engineer, Technical Lead Paperless PartsStaff Machine Learning Engineer, Technical LeadBoston, MA$195,000–$263,000 / yearCollaborative Partner: You seamlessly collaborate with researchers, other engineering teams, and business stakeholders, helping ensure we build the right technology, deploy it scalably, and bring it to market. Step into the role of Technical Lead for our newly formed engineering pod, building the core manufacturing intelligence engine powering the future of Paperless Parts.
Data Scientist – Machine Learning Caris Life SciencesData Scientist – Machine LearningBoston, MassachusettsWorking closely with machine learning scientists, computational biologists, and oncology domain experts, the successful candidate will build models spanning deep learning and statistical approaches, deploy predictive capabilities into the Caris clinical diagnostic platform, publish scientific results, and support collaborations with biopharma partners. Caris Life Sciences is seeking a Data Scientist working in Machine Learning to leverage one of the world’s largest multi‑modal cancer datasets to develop novel machine learning models that integrate molecular and clinical data to advance understanding of cancer biology and improve patient outcomes.
Machine Learning Scientist II - Pricing & Profitability Algorithms WayfairMachine Learning Scientist II - Pricing & Profitability AlgorithmsBoston, MAWhat You’ll Do: Design, build, deploy and refine large-scale machine learning models and algorithmic decision-making systems that solve real-world problems for customers. We’re a community of innovators, risk-takers, and trailblazers who celebrate our differences, and know that our unique perspectives make us stronger, smarter, and well-positioned for success.
Software Machine Learning Engineer TeradyneSoftware Machine Learning EngineerNorth Reading, MA$116,500–$186,400 / yearYou will work closely with cross-functional teams to build scalable ML systems that model complex relationships in engineering data, optimize decision-making processes, and provide transparent, explainable insights. ATTENTION APPLICANTS WITH DISABILITIES: If you’re unable to access our on-line application due to a disability you may visit one of our locations or our Corporate Office at 600 Riverpark Drive, North Reading, MA and request a paper application form.
Machine Learning Scientist, Applied Machine Learning and Agentic AI, Pharma R&D Tempus AI IncMachine Learning Scientist, Applied Machine Learning and Agentic AI, Pharma R&DBoston, MA$100,000–$150,000 / yearThe Machine Learning Scientist, Applied Machine Learning and Agentic AI will contribute to the technical development of cutting-edge agentic frameworks designed to automate the discovery of novel prognostic and predictive models in oncology. You will apply advanced scientific methodologies to develop new predictive models and utilize causal inference frameworks to analyze vast multimodal oncology data, helping to scale scientific discovery from a manual process to a high-throughput, automated engine.
Staff Machine Learning Engineer Xometry IncStaff Machine Learning EngineerWaltham, MA$200,000–$220,000 / yearYou will be the data engineering lead for the digital thread that connects Xometry''s platform to our partner's ecosystem - Solid Edge, NX, Designcenter, and Teamcenter - building the pipelines, contracts, and observability that move quotes, parts, manufacturability signals, and pricing between the two systems in real time. Bachelor''s degree in a STEM field (or equivalent experience) plus 6-8 years of experience in machine learning engineering, with a track record of owning and delivering complex ML systems in production.
Machine Learning Scientist II - Supply Chain AI WayfairMachine Learning Scientist II - Supply Chain AIBoston, MA$176,000–$184,250 / yearPhD with 0-1+ years of experience or Master’s in a STEM field (Engineering, Computer Science, Data Science, Machine Learning, or a related quantitative field) with 2+ years of full-time industry experience in applied research. Work cross-functionally with product managers and commercial stakeholders to understand business problems or opportunities, and iteratively develop ML solutions maximizing business ROI.
Machine Learning Engineer - News, Books, and Stocks Team AppleMachine Learning Engineer - News, Books, and Stocks TeamCambridge, MARole Number:** 200660323-1242 **Summary** In a time where the news and book media landscapes are changing by the day, Apple News and Apple Books stand as champions of quality content, expert curation, user privacy, and the judicious use of machine learning. The team uses machine learning to tackle difficult and complicated problems in the news, books, and stocks domains, including text extraction, named entity recognition, duplicate detection, search, ranking, and much more!
NewMachine Learning Engineer MatrixSpaceMachine Learning EngineerBurlington, MARemote$165,000–$200,000 / yearThis is an engineering-heavy ML role focused on productionizing algorithms created by Data Scientists, with some ownership of the ML infrastructure that helps those Data Scientists move faster. Enjoys bridging the gap between research and production, finding practical engineering solutions that make advanced ML usable in real-world products.
Adjunct Instructor in Machine Learning Engineering and MLOps Brandeis UniversityAdjunct Instructor in Machine Learning Engineering and MLOpsWaltham, MACourse Logistics and Facilitation: Focuses on the organized and timely rollout of course content, maintaining consistent communication through weekly announcements, and ensuring all instructional activities occur within university-approved digital platforms. Instructor Presence and Engagement: Centers on building an active teaching persona by hosting live introductory sessions, facilitating weekly academic discourse in forums, and maintaining regular availability for student consultation.
Machine Learning Scientist II - Supply Chain AI Wayfair LLCMachine Learning Scientist II - Supply Chain AIBoston, MA$176,000–$184,250 / yearWe Are a Match Because You Have: PhD with 0-1+ years of experience or Master's in a STEM field (Engineering, Computer Science, Data Science, Machine Learning, or a related quantitative field) with 2+ years of full-time industry experience in applied research. Work cross-functionally with product managers and commercial stakeholders to understand business problems or opportunities, and iteratively develop ML solutions maximizing business ROI.
Staff Machine Learning Engineer - News, Books, and Stocks Team AppleStaff Machine Learning Engineer - News, Books, and Stocks TeamCambridge, MA
Staff Machine Learning Engineer SamsaraStaff Machine Learning EngineerBoston, MARemoteYou believe customers are more than a number: Samsara engineers enjoy a rare closeness to the end user and you will have the opportunity to participate in customer interviews, collaborate with customer success and product managers, and use metrics to ensure our work is translating into better customer outcomes. • You want to impact the industries that run our world: The software, firmware, and hardware you build will result in real-world impact—helping to keep the lights on, get food into grocery stores, and most importantly, ensure workers return home safely.
Lead Machine Learning Engineer Capital One Financial CorpLead Machine Learning EngineerCambridge, MA$197,300–$225,100 / yearIn this role, you'll be expected to perform many ML engineering activities, including one or more of the following: Partner with a cross-functional team of engineers, data scientists, product managers, and designers to deliver AI-powered products that change how our associates work and provide value to our customers. Design, develop, test, deploy, and support AI software components utilizing machine learning models, including model evaluation and experimentation, large language model inference, similarity search, guardrails, governance, observability and agentic AI.
Research Scientist or Postdoctoral Associate in Formal Methods for Security and Machine Learning UMass LowellResearch Scientist or Postdoctoral Associate in Formal Methods for Security and Machine LearningLowell, MassachusettsAnitha Gollamudi at the Richard Miner School of Computer Science and Information, invites applications for a postdoctoral associate or research scientist position in the area of formal methods for security and machine learning. Special Instructions to Applicants: Only current UML Employees within the Grants & Contracts (MTA/GRACE) bargaining unit will be considered during the first 10 business days of the posting.
Machine Learning Engineer - Semantic Reasoning (Highway) Zoox IncMachine Learning Engineer - Semantic Reasoning (Highway)Boston, MA$189,000–$258,000 / yearIn this role, you will focus on critical initiatives alongside partner Perception and motion planning teams to develop production-grade multi-task transformers, and integrate cutting-edge Vision Language Action (VLA) model outputs to build comprehensive spatial representations for our fleet. Model Training & Deployment: Design, train, and deploy deep learning models for semantic reasoning, specifically tailored to achieve the extended spatial range and high fidelity required for high-speed highway environments.
Machine Learning Scientist II - Gen AI SimpliSafe IncMachine Learning Scientist II - Gen AIBoston, MA$127,300–$186,700 / yearResponsibilities: • Develop and fine-tune large language models (LLMs) and vision-language models (VLMs) to address real-world challenges in the home security space • Work with key stakeholders to identify key research initiatives that can have impact on business outcomes • Take research initiatives from idea generation to production • Collaborate with engineers and product managers to integrate capabilities into our existing systems • Stay up-to-date on the latest advancements in LLMs, VLMs, and multimodal systems • Evaluate new techniques for potential adoption and improvement of internal capabilities. As a key contributor, you will play a crucial role in developing and implementing cutting-edge machine learning models, with a focus on Computer Vision (CV), Multi-modal Large Language Models (LLMs) and Agentic AI to enhance our products and services.
Machine Learning Quantitative Research Analyst State Street CorpMachine Learning Quantitative Research AnalystCambridge, MA$110,000–$180,000 / yearMust also have: professional hands-on ability with Excel, PowerPoint, MATLAB, Python, SQL; experience applying machine learning techniques to financial and economic data, theoretical and practical concepts in machine learning; experience working with simulation techniques (Monte Carlo, Bootstrap), econometric techniques, and statistical techniques (regression, principle components analysis); knowledge of Portfolio theory, mean-variance optimization, back testing, and designing investment strategies; experience with asset pricing models, FX market analysis, and macro factors that influence the market; and demonstrated written communication skills suitable for authoring white papers and journal articles, ability to explain complex concepts in a clear and concise manner. Specific duties include: supporting the team's new research on the thoughtful application of AI and machine learning to economics and finance; co-authoring white papers and journal articles in collaboration with colleagues; translating this academic research into practical applications and products (publications, indicators, tools, etc.); building calculation engines in Python for internal and client-facing tools; running customized analysis for clients and creating written reports; and engaging with clients as a subject matter expert on our related research.
Machine Learning Engineer, Alexa AI Amazon.com IncMachine Learning Engineer, Alexa AIBoston, MAOur mission is to provide scalable and reliable evaluation of the state-of-the-art Conversational AI on how customers perceive the assistants they interact with - from the metrics themselves to software applications to deep dive on those metrics - allowing assistant developers to improve their services. You will collaborate closely with Applied Scientists and other MLEs, leverage Amazon's heterogeneous data sources and large-scale computing resources to accelerate development of Generative Artificial Intelligence solutions.
Adjunct Instructor in Clinical Data Science and Machine Learning Brandeis UniversityAdjunct Instructor in Clinical Data Science and Machine LearningWaltham, MACourse Logistics and Facilitation: Focuses on the organized and timely rollout of course content, maintaining consistent communication through weekly announcements, and ensuring all instructional activities occur within university-approved digital platforms. Instructor Presence and Engagement: Centers on building an active teaching persona by hosting live introductory sessions, facilitating weekly academic discourse in forums, and maintaining regular availability for student consultation.
Machine Learning Systems Engineer Motional IncMachine Learning Systems EngineerBoston, MARemote$144,000–$192,000 / yearOur team is behind some of the industry's largest leaps forward, including the first fully-autonomous cross-country drive in the U.S, the launch of the world's first robotaxi pilot, and operation of the world's longest-standing public robotaxi fleet. We aren't just developing driverless cars; we're creating safer roadways, more equitable transportation options, and making our communities better places to live, work, and connect.
Machine Learning Engineer Modulate IncMachine Learning EngineerSomerville, MA$170,000–$200,000 / yearWe may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. You''ll work closely with researchers, engineers, product leaders, and executives to bring innovative ML solutions from concept to production.
Associate Machine Learning Engineer Manulife Financial CorpAssociate Machine Learning EngineerBoston, MA$80,625–$134,375 / yearPosition Responsibilities: Building of GenAI and AI solutions, including but not limited to analytical model development and implementation, prompt engineering, general all-purpose programming (e.g., Python), testing, communication of results, front end and back-end integration, and iterative development with business subject matter expertise. Proven experience with Databricks and Azure cloud services and data solutions including but not limited to Azure SQL Data Warehouse, Azure Cosmos DB, Azure Data Lake Storage, Azure Function and Azure Data Factory.
Staff/Senior Machine Learning Engineer, Clinical AI Tempus AI IncStaff/Senior Machine Learning Engineer, Clinical AIBoston, MA$170,000–$230,000 / yearAs a Staff/Senior Machine Learning Engineer, you'll play a crucial role in leveraging and deploying cutting-edge natural language processing models and LLMs specifically tailored for healthcare applications at scale. Strong written and verbal communication, including experience authoring and reviewing design docs (RFCs, PRDs, or equivalent); partners well with research scientists, PMs, and clinicians.
Machine Learning Applied Researcher - Speech, Vision and Audio Apple IncMachine Learning Applied Researcher - Speech, Vision and AudioCambridge, MAIn this role, you will take on high-risk, high-reward challenges - researching, designing, and improving state-of-the-art deep learning models trained on unique data, implementing novel machine learning algorithms, and developing solutions to problems that dont have obvious answers. Your scope will encompass various ML subfields and modalities, combining ideas from different fields to solve unique challenges and deliver solutions adopted broadly across teams.
Staff Machine Learning Engineer Chewy IncStaff Machine Learning EngineerBoston, MA$186,500–$297,500 / yearDirectly influence and collaborate with Product and Engineering leaders to evolve solutions using applied science to improve selection, ranking, relevance, deal-offerings, click through prediction models, dynamic bidding, and auction algorithms for Chewy onsite and offsite advertising solutions. What You'll Need: An advanced degree (M.S., PhD, or equivalent experience) in Operations Research, Statistics, Applied Mathematics, Data Science or related field or proven experience for at least 3 years designing optimization and machine learning solutions for large scale applications.
Staff Machine Learning Engineer - Generative AI XometryStaff Machine Learning Engineer - Generative AIWaltham, MAThis is a rare opportunity to shape the future of manufacturing by applying cutting-edge AI research to real-world problems: from multimodal document understanding, to extracting structured data from technical drawings, to building new ways of reasoning across text, images, and 3D data. Xometry's digital marketplace gives manufacturers the critical resources they need to grow their business while also making it easy for buyers at Fortune 1000 companies to tap into global manufacturing capacity.
Machine Learning Ops Eng II Boston Children's HospitalMachine Learning Ops Eng IIMA$74,089.60–$118,549.60 / yearThis role is pivotal in developing and scaling advanced AI and machine learning projects, enhancing data frameworks, and optimizing data flows to support the hospital's strategic initiatives. The ML Ops Engineer II works in close collaboration with data scientists and various stakeholders across the hospital to develop solutions that improve patient care outcomes and operational efficiency.
Senior AI / Machine Learning Engineer Absentia LabsSenior AI / Machine Learning EngineerBoston, MassachusettsThis role is intended for engineers who have trained large models in real production environments, understand the realities of scale, and can reason about both learning dynamics and systems constraints. Design, train, and evaluate large-scale models, including Large Language Models (LLMs), diffusion models, and Graph Neural Networks (GNNs).
Founding Machine Learning Engineer Work at OnescreenFounding Machine Learning EngineerBoston, MassachusettsDesign and ship matching and ranking models for OOH inventory: candidate generation, re-ranking, geospatial-aware scoring. Real ranking and matching modeling fluency — learning-to-rank, retrieval and re-rank patterns, not just classification.