Cloudy with a chance of neurons: The tools that make neural networks work – Ars Technica
Enlarge / Machine learning is really good at turning pictures of normal things into pictures of eldritch horrors.
Jim Salter
Artificial Intelligenceor, if you prefer, Machine Learningis today's hot buzzword. Unlike many buzzwords have come before it, though, this stuff isn't vaporware dreamsit's real, it's here already, and it's changing your life whether you realize it or not.
Before we go too much further, let's talk quickly about that term "Artificial Intelligence." Yes, it's warranted; no, it doesn't mean KITT from Knight Rider, or Samantha, the all-too-human unseen digital assistant voiced by Scarlett Johansson in 2013'sHer. Aside from being fictional, KITT and Samantha are examples ofstrong artificial intelligence, also known as Artificial General Intelligence (AGI). On the other hand, artificial intelligencewithout the "strong" or "general" qualifiersis an established academic term dating back to the 1955 proposal for the Dartmouth Summer Project on Artificial Intelligence (DSRPAI), written by Professors John McCarthy and Marvin Minsky.
All "artificial intelligence" really means is a system that emulates problem-solving skills normally seen in humans or animals. Traditionally, there are two branches of AIsymbolic and connectionist. Symbolic means an approach involving traditional rules-based programminga programmer tells the computer what to expect and how to deal with it, very explicitly. The "expert systems" of the 1980s and 1990s were examples of symbolic (attempts at) AI; while occasionally useful, it's generally considered impossible to scale this approach up to anything like real-world complexity.
NBCUniversal
Artificial Intelligence in the commonly used modern sense almost always refers to connectionist AI. Connectionist AI, unlike symbolic AI, isn't directly programmed by a human. Artificial neural networks are the most common type of connectionist AI, also sometimes referred to as machine learning. My colleague Tim Lee just got done writing about neural networks last weekyou can get caught up right here.
If you wanted to build a system that could drive a car, instead of programming it directly you might attach a sufficiently advanced neural network to its sensors and controls, and then let it "watch" a human driving for tens of thousands of hours. The neural network begins to attach weights to events and patterns in the data flow from its sensors that allow it to predict acceptable actions in response to various conditions. Eventually, you might give the network conditional control of the car's controls and allow it to accelerate, brake, and steer on its ownbut still with a human available. The partially trained neural network can continue learning in response to when the human assistant takes the controls away from it. "Whoops, shouldn't have donethat," and the neural network adjusts weighted values again.
Sounds very simple, doesn't it? In practice, not so muchthere are many different types of neural networks (simple, convolutional, generative adversarial, and more), and none of them is very bright on its ownthe brightest is roughly similar in scale to a worm's brain. Most complex, really interesting tasks will require networks of neural networks that preprocess data to find areas of interest, pass those areas of interest onto other neural networks trained to more accurately classify them, and so forth.
One last piece of the puzzle is that, when dealing with neural networks, there are two major modes of operation: inference and training. Training is just what it sounds likeyou give the neural network a large batch of data that represents a problem space, and let it chew through it, identifying things of interest and possibly learning to match them to labels you've provided along with the data. Inference, on the other hand, is using an already-trained neural network to give you answers in a problem space that it understands.
Both inference and training workloads can operate several orders of magnitude more rapidly on GPUs than on general-purpose CPUsbut that doesn't necessarily mean you want to do absolutely everything on a GPU. It's generally easier and faster to runsmall jobs directly on CPUs rather than invoking the initial overhead of loading models and data into a GPU and its onboard VRAM, so you'll very frequently see inference workloads run on standard CPUs.
Read the original post:
Cloudy with a chance of neurons: The tools that make neural networks work - Ars Technica
- This Machine Learning Paper from Stanford and the University of Toronto Proposes Observational Scaling Laws: Highlighting the Surprising... - May 27th, 2024 [May 27th, 2024]
- Reinforcement learning AI might bring humanoid robots to the real world - Science News Magazine - May 27th, 2024 [May 27th, 2024]
- Machine learning was used to sync subtitles in Marvel's Spider-Man 2 - Game Developer - May 27th, 2024 [May 27th, 2024]
- Study uses AI and machine learning to accelerate protein engineering process - Dailyuw - May 27th, 2024 [May 27th, 2024]
- Scientists leverage machine learning to decode gene regulation in the developing human brain - Medical Xpress - May 27th, 2024 [May 27th, 2024]
- The 2034 Millionaire's Club: 3 Machine Learning Stocks to Buy Now - InvestorPlace - May 27th, 2024 [May 27th, 2024]
- UK Regulators Share Views on Artificial Intelligence and Machine Learning Regulation - JD Supra - May 27th, 2024 [May 27th, 2024]
- A double machine learning model for measuring the impact of the Made in China 2025 strategy on green economic ... - Nature.com - May 27th, 2024 [May 27th, 2024]
- Machine learning models for predicting early hemorrhage progression in traumatic brain injury | Scientific Reports - Nature.com - May 27th, 2024 [May 27th, 2024]
- Scientists leverage machine learning to decode gene regulation in the developing human brain - EurekAlert - May 27th, 2024 [May 27th, 2024]
- AI Startup Says California AI Bill Will Hamper Innovation - BroadbandBreakfast.com - May 27th, 2024 [May 27th, 2024]
- Airbnb using machine learning technology to prevent parties - KYW - May 27th, 2024 [May 27th, 2024]
- Bringing generative artificial intelligence to space - SpaceNews - May 27th, 2024 [May 27th, 2024]
- Here's how AI and ML are shaping the future of machine design - Interesting Engineering - May 27th, 2024 [May 27th, 2024]
- The 3 Best Machine Learning Stocks to Quadruple Your Money by 2035 - InvestorPlace - May 23rd, 2024 [May 23rd, 2024]
- Simple Behavioral Analysis (SimBA) as a platform for explainable machine learning in behavioral neuroscience - Nature.com - May 23rd, 2024 [May 23rd, 2024]
- Slack is training its machine learning on your chat behavior unless you opt out via email - TechRadar - May 23rd, 2024 [May 23rd, 2024]
- Cosmic Leap: NASA Swift Satellite and AI Unravel the Distance of the Farthest Gamma-Ray Bursts - UNLV NewsCenter - May 23rd, 2024 [May 23rd, 2024]
- Pain-related Sodium Channels in Drug-target Interaction Network: A Machine Learning Analysis - Physician's Weekly - May 23rd, 2024 [May 23rd, 2024]
- TikTok moves toward 'performance automation vision' with latest machine learning ad tools - Digiday - May 23rd, 2024 [May 23rd, 2024]
- Inversely optimized design of Al-Mg-Si alloys using machine learning methods - ScienceDirect.com - May 23rd, 2024 [May 23rd, 2024]
- Pipe welding integrates machine learning to boost production - TheFabricator.com - May 23rd, 2024 [May 23rd, 2024]
- US Pharma and Biotech Summit 2024: Artificial Intelligence and Machine Learning Through the Eyes of the FDA Part II - Pharmaceutical Executive - May 23rd, 2024 [May 23rd, 2024]
- Machine learning drafted to aid Phase 3 testing of ALS therapy PrimeC - ALS News Today - May 23rd, 2024 [May 23rd, 2024]
- Bolstering environmental data science with equity-centered approaches - EurekAlert - May 23rd, 2024 [May 23rd, 2024]
- Machine Learning Stocks to Buy That Are Millionaire-Makers: May - InvestorPlace - May 23rd, 2024 [May 23rd, 2024]
- Machine learning models improve the prediction of groundwater depth in the Ningxia area of China - Phys.org - May 23rd, 2024 [May 23rd, 2024]
- AI-Driven Robotics and Quality Control: Transforming Electronics Assembly and Manufacturing - Robotics and Automation News - May 23rd, 2024 [May 23rd, 2024]
- Machine Learning vs. Deep Learning: What's the Difference? - Gizmodo - May 23rd, 2024 [May 23rd, 2024]
- Slack has been using data from your chats to train its machine learning models - Engadget - May 23rd, 2024 [May 23rd, 2024]
- Machine learning-based integration develops an immunogenic cell death-derived lncRNA signature for predicting ... - Nature.com - May 23rd, 2024 [May 23rd, 2024]
- Strengthening a Commitment to Diversity and Inclusion in R&D With the Help of Novel Machine Learning Approaches - Technology Networks - May 23rd, 2024 [May 23rd, 2024]
- Transforming manufacturing with AI and machine learning: Real-world applications and data management integration - The Manufacturer - May 23rd, 2024 [May 23rd, 2024]
- Following ad business overhaul, Snap will ramp up investments in AI and machine learning - The Drum - May 23rd, 2024 [May 23rd, 2024]
- How the State Department used AI and machine learning to revolutionize records management - FedScoop - May 23rd, 2024 [May 23rd, 2024]
- Characterization of PANoptosis-related genes in Crohn's disease by integrated bioinformatics, machine learning and ... - Nature.com - May 23rd, 2024 [May 23rd, 2024]
- Australian Academy of Science Boden Research Conference 2024: Protein Folding: Mechanisms, Health, and Machine ... - Australian Academy of Science - May 23rd, 2024 [May 23rd, 2024]
- How Machine Learning Revolutionizes Automation Security with AI-Powered Defense - Automation.com - May 23rd, 2024 [May 23rd, 2024]
- 52% of FIs Plan to Lean on ML and AI to Combat Fraud - PYMNTS.com - May 23rd, 2024 [May 23rd, 2024]
- DeepDive: estimating global biodiversity patterns through time using deep learning - Nature.com - May 23rd, 2024 [May 23rd, 2024]
- Prediction of incomplete immunization among under-five children in East Africa from recent demographic and health ... - Nature.com - May 23rd, 2024 [May 23rd, 2024]
- Optimization of wear parameters for ECAP-processed ZK30 alloy using response surface and machine learning ... - Nature.com - April 22nd, 2024 [April 22nd, 2024]
- Machine learning approach predicts heart failure outcome risk - HealthITAnalytics.com - April 22nd, 2024 [April 22nd, 2024]
- Practical approaches in evaluating validation and biases of machine learning applied to mobile health studies ... - Nature.com - April 22nd, 2024 [April 22nd, 2024]
- Application of power-law committee machine to combine five machine learning algorithms for enhanced oil recovery ... - Nature.com - April 22nd, 2024 [April 22nd, 2024]
- Free tool uses machine learning to pick better molecules for testing new reactions - Chemical & Engineering News - April 22nd, 2024 [April 22nd, 2024]
- Automated Analysis of Nuclear Parameters in Oral Exfoliative Cytology Using Machine Learning - Cureus - April 22nd, 2024 [April 22nd, 2024]
- An AI Ethics Researcher's Take On The Future Of Machine Learning In The Art World - SlashGear - April 22nd, 2024 [April 22nd, 2024]
- Enhancing Emotion Recognition in Users with Cochlear Implant Through Machine Learning and EEG Analysis - Physician's Weekly - April 22nd, 2024 [April 22nd, 2024]
- Imageomics Applies AI and Vision Advancements to Biological Questions - Photonics.com - April 22nd, 2024 [April 22nd, 2024]
- Machine learning reveals the control mechanics of an insect wing hinge - Nature.com - April 22nd, 2024 [April 22nd, 2024]
- The Future of ML Development Services: Trends and Predictions - FinSMEs - April 22nd, 2024 [April 22nd, 2024]
- CSRWire - Island Conservation Harnesses Machine Learning Solutions From Lenovo and NVIDIA To Restore Island ... - CSRwire.com - April 22nd, 2024 [April 22nd, 2024]
- Investigation of the effectiveness of a classification method based on improved DAE feature extraction for hepatitis C ... - Nature.com - April 22nd, 2024 [April 22nd, 2024]
- Machine Learning Uncovers New Ways to Kill Bacteria With Non-Antibiotic Drugs - ScienceAlert - April 22nd, 2024 [April 22nd, 2024]
- Formal Interaction Model (FIM): A Mathematics-based Machine Learning Model that Formalizes How AI and Users Shape One Another - MarkTechPost - April 22nd, 2024 [April 22nd, 2024]
- A secure approach to generative AI with AWS | Amazon Web Services - AWS Blog - April 22nd, 2024 [April 22nd, 2024]
- Imbalanced Learn: the Python library for rebuilding ML datasets - DataScientest - April 22nd, 2024 [April 22nd, 2024]
- AI has a lot of terms. We've got a glossary for what you need to know - Quartz - April 22nd, 2024 [April 22nd, 2024]
- Texxa AI, Where ideas take flight: Revolutionizing AI Solutions for Businesses and Individuals - GlobeNewswire - April 22nd, 2024 [April 22nd, 2024]
- Using machine learning to identify patients with cancer that would benefit from immunotherapy - Medical Xpress - April 22nd, 2024 [April 22nd, 2024]
- Researchers at Stanford University Explore Direct Preference Optimization (DPO): A New Frontier in Machine Learning and Human Feedback - MarkTechPost - April 22nd, 2024 [April 22nd, 2024]
- Machine Learning Helps Scientists Locate the Neurological Origin of Psychosis - ExtremeTech - April 22nd, 2024 [April 22nd, 2024]
- Slack delivers native and secure generative AI powered by Amazon SageMaker JumpStart | Amazon Web Services - AWS Blog - April 22nd, 2024 [April 22nd, 2024]
- Accurate and rapid antibiotic susceptibility testing using a machine learning-assisted nanomotion technology platform - Nature.com - March 20th, 2024 [March 20th, 2024]
- AI reveals the complexity of a simple birdsong - The Washington Post - March 20th, 2024 [March 20th, 2024]
- Researchers from MIT and Harvard Developed UNITS: A Unified Machine Learning Model for Time Series Analysis that Supports a Universal Task... - March 20th, 2024 [March 20th, 2024]
- Undergraduate Researchers Help Unlock Lessons of Machine Learning and AI - College of Natural Sciences - March 20th, 2024 [March 20th, 2024]
- Machine Learning Accelerates the Simulation of Dynamical Fields - Eos - March 20th, 2024 [March 20th, 2024]
- Inter hospital external validation of interpretable machine learning based triage score for the emergency department ... - Nature.com - March 20th, 2024 [March 20th, 2024]
- HEAL: A framework for health equity assessment of machine learning performance - Google Research - March 20th, 2024 [March 20th, 2024]
- Expert on how machine learning could lead to improved outcomes in urology - Urology Times - March 20th, 2024 [March 20th, 2024]
- Unlock the potential of generative AI in industrial operations | Amazon Web Services - AWS Blog - March 20th, 2024 [March 20th, 2024]
- Optimize price-performance of LLM inference on NVIDIA GPUs using the Amazon SageMaker integration with NVIDIA ... - AWS Blog - March 20th, 2024 [March 20th, 2024]
- Orange isn't building its own AI foundation model here's why - Light Reading - March 20th, 2024 [March 20th, 2024]
- Wall Street's Favorite Machine Learning Stocks? 3 Names That Could Make You Filthy Rich - InvestorPlace - March 20th, 2024 [March 20th, 2024]
- Edge Impulse machine learning platform adds support for NVIDIA TAO Toolkit and Omniverse - CNX Software - March 20th, 2024 [March 20th, 2024]
- MIT Researchers Developed an Image Dataset that Allows Them to Simulate Peripheral Vision in Machine Learning Models - MarkTechPost - March 20th, 2024 [March 20th, 2024]
- 18 Cutting-Edge Artificial Intelligence Applications in 2024 - Simplilearn - March 20th, 2024 [March 20th, 2024]
- Machine-learning-based global optimization of microwave passives with variable-fidelity EM models and response ... - Nature.com - March 20th, 2024 [March 20th, 2024]