Machine Learning Discipline

Machine Learning is the branch of artificial intelligence in which systems learn predictive or generative models directly from data, without being explicitly programmed with domain rules. It encompasses supervised, unsupervised, and reinforcement learning paradigms, and forms the foundation for deep learning, natural language processing, and computer vision applications. Practical machine learning involves data preparation, feature engineering, model selection, training, evaluation, and deployment within a production pipeline.

Semantic Classification

Content

• Machine learning (ML) is a process that enables computational systems to understand data and gain knowledge from experience without being explicitly programmed. Machine learning systems improve their performance through exposure to data and learn patterns to make predictions or decisions based on statistical patterns in the data.

  Source: ISO/IEC 22989:2022, Clause 3.1.8 - Authority Score: 0.95

Paradigms of Scientific Discovery

• Bishop discusses the five paradigms of scientific discovery, drawing on the work of Jim Gray.
  • Empirical Paradigm: Observation and experimentation (e.g., a cave dweller dropping rocks).
  • Theoretical Paradigm: Describing nature through mathematical equations (e.g., Newton’s laws, Maxwell’s equations, Schrödinger’s equation).
  • Simulation Paradigm: Using digital computers to solve complex equations (e.g., weather forecasting).
  • Data-Intensive Paradigm: Utilising large datasets and machine learning (e.g., particle physics at CERN).
  • Fifth Paradigm: Training machine learning systems using simulation data to create emulators, which are much faster than traditional simulations.

Microsoft AI for Science

• Chris Bishop is Microsoft Technical Fellow and Director of Microsoft Research AI for Science. (Microsoft Research Podcast)

  • Factors include data availability (both experimental and synthetic), the potential for real-world impact at scale, and bottlenecks in existing processes.

  • Microsoft focuses on the molecular level, given the enormous space of potential molecules for drugs, materials, and more.

    Academic Context

• Machine learning represents a fundamental paradigm shift in computational systems, enabling algorithms to improve performance through data exposure rather than explicit programming[2][4]

• Formally defined as a subset of artificial intelligence that uses statistical methods and computational techniques to identify patterns and optimise model parameters[1][3]

• Distinguishes itself from traditional programming by allowing systems to adapt and modify behaviour based on experience with data, independent of programmer assumptions[4]

• Grounded in statistical inference and symbolic logic, with modern implementations increasingly relying on statistical models rather than rule-based systems[4]

• The intersection of machine learning with ontologies and knowledge representation has emerged as a particularly innovative research space[5]

• Ontologies provide formal specifications of concepts, relationships, and properties that enable machines to process information with greater semantic expressiveness[2][3]

• Machine learning systems utilise ontological frameworks to extract, code, and analyse structured and unstructured information more effectively[5]

  Current Landscape (2025)

• Industry adoption and implementations

• Machine learning has become embedded across consumer-facing systems including voice assistants (Siri, Alexa), autonomous vehicles (Tesla), and customer service platforms (Cogito)[4]

• Applications span predictive analytics, precision medicine, and differential diagnosis in clinical settings[5]

• Systems now routinely update their knowledge bases through experience with data, enabling continuous improvement without explicit reprogramming[4]

• Technical capabilities and limitations

• Machines can gather inputs, process them through statistical models, and synthesise information to generate hypotheses and classify knowledge[4]

• Pattern recognition and generalisation capabilities allow learned patterns to apply to previously unseen data[1]

• Performance improvements occur iteratively through training processes and exposure to training datasets[1]

• Effectiveness depends significantly on data quality, quantity, and representativeness—systems struggle with vague or vacuous naming conventions and sparse datasets[1]

• Standards and frameworks

• ISO/IEC 22989:2022 provides formal definitions emphasising learning from experience without explicit programming

• ISO/IEC 23053:2022 focuses on model parameter optimisation through computational techniques

• NIST frameworks address machine learning lifecycle ontologies for capturing and structuring ML system information[6]

  Research & Literature

• Key academic papers and sources

• Doan, P. et al. (2003). Ontology Matching: A Machine Learning Approach. Proceedings of the International Semantic Web Conference. Demonstrates GLUE system using machine learning to create semantic mappings between ontologies, focusing on taxonomy correspondences[1]

• Feilmayr, C. & Wöß, W. (2016). An analysis of ontologies and their success factors for application to business. Data & Knowledge Engineering, 101, 1-23. Refines ontology definitions emphasising formal, explicit specifications of shared conceptualisations with high semantic expressiveness[2]

• Gruber, T. R. (1993). A translation approach to portable ontology specifications. Knowledge Acquisition, 5(2), 199-220. Foundational work distinguishing ontologies from taxonomies and establishing that ontologies require axioms constraining possible interpretations[2]

• Ongoing research directions

• Natural language processing integration with ontologies for extracting structured information from electronic health records and medical texts[5]

• Word and node embedding algorithms supplementing NLP capabilities in clinical and research contexts[5]

• Hybrid approaches combining ontological frameworks with machine learning for improved semantic understanding[5]

• Experimental frameworks exploring AI-human co-evolution structures, though these remain nascent in academic discourse[2]

  UK Context

• British contributions to machine learning research remain substantial, though the search results do not identify specific North England innovation hubs with particular relevance to machine learning ontologies

• UK academic institutions contribute significantly to ontology research and knowledge representation frameworks

• Clinical applications of machine learning with ontological support are being implemented across NHS systems for precision medicine and diagnostic support[5]

  Future Directions

• Emerging trends and developments

• Machines increasingly receiving “prebuilt knowledge” based on common sense and general knowledge repositories (OpenCyc, WordNet), enhancing diagnostic and analytical capabilities[4]

• Greater ability to suggest medical diagnoses, analyse market trends, and perform complex customer service functions through improved ontological representations[4]

• Continued convergence of semantic technologies with machine learning systems for more sophisticated information processing[5]

• Anticipated challenges

• Ontologies require continuous refinement as new evidence and data inputs modify understanding of domains—static ontologies become obsolete[4]

• Balancing formal semantic expressiveness with computational efficiency remains an ongoing challenge[2]

• Ensuring machine learning systems maintain interpretability and alignment with human understanding as complexity increases[5]

• Research priorities

• Developing robust frameworks for ontology maintenance and evolution within machine learning pipelines[4]

• Advancing hybrid approaches that combine symbolic logic with statistical models for improved reasoning[4]

• Establishing standardised practices for knowledge representation in clinical and enterprise machine learning applications[5]

  References

  1. Doan, P., Madhavan, J., Domingos, P., & Halevy, A. (2003). Ontology Matching: A Machine Learning Approach. In Proceedings of the International Semantic Web Conference. Available at: https://homes.cs.washington.edu/~pedrod/papers/hois.pdf

  2. Gruber, T. R. (1993). A translation approach to portable ontology specifications. Knowledge Acquisition, 5(2), 199-220.

  3. Feilmayr, C. & Wöß, W. (2016). An analysis of ontologies and their success factors for application to business. Data & Knowledge Engineering, 101, 1-23.

  4. Bowles, M. (2024). Taxonomy vs Ontology: Machine Learning Breakthroughs. Dataversity. Available at: https://www.dataversity.net/articles/taxonomy-vs-ontology-machine-learning-breakthroughs/

  5. Hripcsak, G. & Albers, D. J. (2020). Ontologies, Knowledge Representation, and Machine Learning for Clinical Research. Yearbook of Medical Informatics, 29(1), 159-162. DOI: 10.1055/s-0040-1701991

  6. National Institute of Standards and Technology (NIST). An Introduction to Machine Learning Lifecycle Ontology and its Applications. Available at: https://www.nist.gov/publications/introduction-machine-learning-lifecycle-ontology-and-its-applications

Provenance