Are AI-Engineered Threats FUD or Reality? – Dark Reading
The moment that generative AI applications hit the market, it changed the pace of business not only for security teams, but for cybercriminals too. Today, not embracing AI innovations can mean falling behind your competitors and putting your cyber defense at a disadvantage against cyberattacks powered by AI. But when discussing how AI will or won't impact cybercrime, it's important that we look at things through a pragmatic and sober lens not feeding into hype that reads more like science fiction.
Today's AI advancements and maturity signal a significant leap forward for enterprise security. Cybercriminals can't easily match the size and scale of enterprises' resources, skills, and motivation, making it harder for them to keep up with the current speed of AI innovation. Private venture investment in AI exploded to $93.5 billion in 2021 the bad guys don't have that level of capital. They also don't have the manpower, computing power, and innovations that affords commercial companies or government more time and opportunity to fail quick, learn fast, and get it right first.
Make no mistake, though: Cybercrime will catch up. This is not the first time the security industry has had a brief edge when ransomware started driving more defenders to adopt endpoint detection and response technologies, attackers needed some time to figure out how to circumvent and evade those detections. That interim "grace period" gave businesses time to better shield themselves. The same applies now: Businesses need to maximize on their lead in the AI race, advancing their threat detection and response capabilities and leveraging the speed and precision that current AI innovations afford them.
So how is AI changing cybercrime? Well, it won't change it substantially anytime soon, but it will scale it in certain instances. Let's take at a look at where malicious use of AI will and won't make the most immediate impact.
In recent months, we've seen claims regarding various malicious use cases of AI, but just because a scenario is possible does not make it probable. Take fully automated malware campaigns, for example logic says that it is possible to leverage AI to achieve that outcome, but given that leading tech companies have yet to pioneer fully automated software development cycles, it's unlikely that financially constrained cybercrime groups will achieve this sooner. Even partial automation can enable the scaling of cybercrime, however, a tactic we've already seen used in Bazar campaigns. This is not an innovation, but a tried-and-true technique that defenders are already taking on.
Another use case to consider is AI-engineered phishing attacks. Not only is this one possible, but we're already beginning to see these attacks in the wild. This next generation of phishing may achieve higher levels of persuasiveness and click-rate, but a human-engineered phish and AI-engineered phish still drive toward the same goal. In other words, an AI-engineered phish is still a phish searching for a click, and it requires the same detection and response readiness.
However, while the problem remains the same, the scale is vastly different. AI acts as a force multiplier to scale phishing campaigns, so, if an enterprise is seeing a spike in inbound phishing emails and those malicious emails are significantly more persuasive then it's likely looking at a high click-rate probability and potential for compromise. AI models can also increase targeting efficacy, helping attackers determine who is the most susceptible target for a specific phish within an organization and ultimately reaching a higher ROI from their campaigns. Phishing attacks have historically been among the most successful tactics that attackers have used to infiltrate enterprises. The scaling of this type of attack emphasizes the critical role that EDR, MDR, XDR, and IAM technologies play in detecting anomalous behavior before it achieves impact.
AI poisoning attacks, in other words programmatically manipulating the code and data on which AI models are built, may be the "holy grail" of attacks for cybercriminals. The impact of a successful poisoning attack could range anywhere from misinformation attempts to Die Hard 4.0. Why? Because by poisoning the model, an attacker can make it behave or function in whatever way they want, and it's not easily detectable. However, these attacks aren't easy to carry out they require gaining access to the data the AI model is training on at the time of training, which is no small feat. As more models become open source, the risk of these attacks will increase, but it will remain low for the time being.
While it's important to separate hype from reality, it's also important to ensure we're asking the right questions about AI's impact on the threat landscape. There are lots of unknowns regarding AI's potential how it may change adversaries' goals and objectives is one we mustn't overlook. It remains unknown how new abilities may help serve new purposes for adversaries and recalibrate their motives.
We may not see an immediate spike in novel AI-enabled attacks, but the scaling of cybercrime thanks to AI will have a substantial impact on organizations that aren't prepared. Speed and scale are intrinsic characteristics of AI, and just as defenders are seeking to benefit from them, so are attackers. Security teams are already understaffed and overwhelmed seeing a spike in malicious traffic or incident response engagements is a substantial weight added onto their workload.
This reaffirms more than ever the need for enterprises to invest in their defenses, using AI to drive speed and precision in their threat detection and response capabilities. Enterprises that take advantage of this "grace period" will find themselves much more prepared and resilient for the day attackers actually do catch up in the AI cyber race.
Read the original post:
Are AI-Engineered Threats FUD or Reality? - Dark Reading
- Google rolls out Gemini Deep Think AI, a reasoning model that tests multiple ideas in parallel - TechCrunch - August 1st, 2025 [August 1st, 2025]
- Big Tech may be breaking the bank for AI, but investors love it - Reuters - August 1st, 2025 [August 1st, 2025]
- Is Amazon Losing Ground To Microsoft And Google in AI? - Investor's Business Daily - August 1st, 2025 [August 1st, 2025]
- Tim Cook Says Apple Is Investing Significantly in AI and Could Buy Another Company - Investopedia - August 1st, 2025 [August 1st, 2025]
- UBS took a sweeping look at the AI revolution and concluded the 'visible' impact is at least 3 years away for consumer firms - Fortune - August 1st, 2025 [August 1st, 2025]
- China has top-flight AI models. But it is struggling to run them - The Economist - August 1st, 2025 [August 1st, 2025]
- The 10 jobs least and most threatened by AI - Axios - August 1st, 2025 [August 1st, 2025]
- Startup Trunk Tools is using AI to reduce construction errors and waste - CNBC - August 1st, 2025 [August 1st, 2025]
- Metas superintelligence isnt here yet. But its AI bets are already paying off - CNN - August 1st, 2025 [August 1st, 2025]
- Ethan Thornton of Mach Industries takes the AI stage at Disrupt 2025 - TechCrunch - August 1st, 2025 [August 1st, 2025]
- 20 jobs and careers AI is unlikely to ever touch, according to Microsoft - Fortune - August 1st, 2025 [August 1st, 2025]
- Palantir Won a Big Army Pact. The AI Firm Is in the Sweet Spot, Says Analyst. - Barron's - August 1st, 2025 [August 1st, 2025]
- Etsy Turns From TV Ads Toward Search, With AI as the Wild Card - The Wall Street Journal - August 1st, 2025 [August 1st, 2025]
- Big Tech's AI and core businesses are blurring together - Yahoo Finance - August 1st, 2025 [August 1st, 2025]
- These 40 Jobs May Be Replaced by AI. These 40 Probably Won't Microsoft study identifies most AI affected jobs - Inc.com - August 1st, 2025 [August 1st, 2025]
- Why You Shouldnt Use AI To Write Your Executive (Legal) Resume Or LinkedIn Profile - Above the Law - August 1st, 2025 [August 1st, 2025]
- Prediction: This Artificial Intelligence (AI) Stock Could Hit a $10 Trillion Valuation by 2035 - The Motley Fool - August 1st, 2025 [August 1st, 2025]
- What is AI, how do apps like ChatGPT work and why are there concerns? - BBC - August 1st, 2025 [August 1st, 2025]
- BG3's Astarion voice actor is 'not interested' in AI: 'Where's the joy in it?' - Polygon - August 1st, 2025 [August 1st, 2025]
- TikTok took the world by storm. Now, Chinese companies are taking videos further with AI - CNBC - August 1st, 2025 [August 1st, 2025]
- 'What am I falling in love with?' Human-AI relationships are no longer just science fiction - CNBC - August 1st, 2025 [August 1st, 2025]
- I Watched AI Agents Try to Hack My Vibe-Coded Website - WIRED - August 1st, 2025 [August 1st, 2025]
- Personal Perspective: AI training is here. But what we need is human training. - Psychology Today - August 1st, 2025 [August 1st, 2025]
- Amazons overwhelming AI demand is just a bronze medal compared to its rivals - Sherwood News - August 1st, 2025 [August 1st, 2025]
- Bidens autopen controversy says more about AI than you might think - The Hill - August 1st, 2025 [August 1st, 2025]
- Enterprise AI is at a tipping Point, heres what comes next - The World Economic Forum - August 1st, 2025 [August 1st, 2025]
- Apple quietens Wall Streets fears of China struggles and slow AI progress - The Guardian - August 1st, 2025 [August 1st, 2025]
- The AI Company Capitalizing on Our Obsession With Excel - The Wall Street Journal - August 1st, 2025 [August 1st, 2025]
- Apple to Significantly Invest in AI, Warns of $1 Billion Tariff Hit - PYMNTS.com - August 1st, 2025 [August 1st, 2025]
- I'm a software engineer, and I've lost my job 4 times in the last 18 years. I don't think AI is the problem. - Business Insider - August 1st, 2025 [August 1st, 2025]
- Exclusive | AI Finance App Ramp Is Valued at $22.5 Billion in Funding Round - The Wall Street Journal - July 30th, 2025 [July 30th, 2025]
- How spy agencies are experimenting with the newest AI models - The Economist - July 30th, 2025 [July 30th, 2025]
- Metas AI Recruiting Campaign Finds a New Target - WIRED - July 30th, 2025 [July 30th, 2025]
- SOCOM adds new advanced AI capabilities to tech wish list - DefenseScoop - July 30th, 2025 [July 30th, 2025]
- We will sign the EU AI Code of Practice. - The Keyword - July 30th, 2025 [July 30th, 2025]
- Why the man behind The Haters Guide to the AI Bubble thinks Wall Streets hottest trade will go bust - MarketWatch - July 30th, 2025 [July 30th, 2025]
- How Do You Think AI Will Impact Jobs In The Next 5-10 Years? - The Seattle Medium - July 30th, 2025 [July 30th, 2025]
- The Trumpification of AI: What Could Go Wrong? - Mother Jones - July 30th, 2025 [July 30th, 2025]
- YouTube to roll out new AI-powered technology aimed at identifying teen users - CBS News - July 30th, 2025 [July 30th, 2025]
- Google says it will sign EUs AI code of practice - TechCrunch - July 30th, 2025 [July 30th, 2025]
- Millions are watching these bizarre AI Bible videos on TikTok. Should you be worried or encouraged? - Premier Christianity Magazine - July 30th, 2025 [July 30th, 2025]
- Silicon Valley's billions of dollars on AI haven't actually generated a return yet. Here's why most companies should embrace 'small AI' instead -... - July 30th, 2025 [July 30th, 2025]
- Alibabas AI coding tool raises security concerns in the West - AI News - July 30th, 2025 [July 30th, 2025]
- How Zuckerbergs Prometheus AI project could change the world as we know it - The Independent - July 30th, 2025 [July 30th, 2025]
- Nvidia AI chip challenger Groq said to be nearing new fundraising at $6B valuation - TechCrunch - July 30th, 2025 [July 30th, 2025]
- How US adults are using AI, according to AP-NORC polling - AP News - July 30th, 2025 [July 30th, 2025]
- Gen AI apps doubled their revenue, grew to 1.7B downloads in first half of 2025 - TechCrunch - July 30th, 2025 [July 30th, 2025]
- The AI browser war is underway. Compare the top browsers from Perplexity, Opera, and more. - Mashable - July 30th, 2025 [July 30th, 2025]
- Aetna Launches New AI and Digital Tools to Improve Access and Care - CVS Health - July 30th, 2025 [July 30th, 2025]
- YouTube is turning over age verification to AI - Engadget - July 30th, 2025 [July 30th, 2025]
- Apple is facing pressure from Wall Street to figure out its AI strategy - CNBC - July 30th, 2025 [July 30th, 2025]
- Google was once the most exciting place on the internet. AI mode will ruin it - The Independent - July 30th, 2025 [July 30th, 2025]
- Microsoft research: Which jobs overlap most with AI tasks? - theregister.com - July 30th, 2025 [July 30th, 2025]
- Amazons AI Coding Revealed a Dirty Little Secret - Bloomberg.com - July 30th, 2025 [July 30th, 2025]
- Apple Loses Fourth AI Researcher in a Month to Metas Superintelligence Team - Bloomberg.com - July 30th, 2025 [July 30th, 2025]
- Could This Once-Hot AI Stock Get Another Shot At Stardom? - Barchart.com - July 30th, 2025 [July 30th, 2025]
- The race to provide AI agents for tedious tasks is on, but should we trust them with our data? - CBC - July 30th, 2025 [July 30th, 2025]
- The Shortcut AI Excel agent could 'one-shot' spreadsheet jobs. Here's how to try it. - Mashable - July 30th, 2025 [July 30th, 2025]
- With Ambiences new mega-round, AI scribes have announced nearly $1 billion in funding this year - statnews.com - July 30th, 2025 [July 30th, 2025]
- Microsoft study identifies 40 jobs AI chatbots are likely to help automate and those where the tech is barely being used - Business Insider - July 30th, 2025 [July 30th, 2025]
- AMD Raises AI Chip Price, Confident It Can Compete With Nvidia - Investor's Business Daily - July 28th, 2025 [July 28th, 2025]
- Opinion | How AI is impacting 700 professions and might impact yours - The Washington Post - July 28th, 2025 [July 28th, 2025]
- AMD Stock Is Rising. Its AI Chip Business Is Improving, Says Analyst. - Barron's - July 28th, 2025 [July 28th, 2025]
- NFL record predictions 2025: AI makes win-loss picks for all 32 teams - USA Today - July 28th, 2025 [July 28th, 2025]
- China's latest AI model claims to be even cheaper to use than DeepSeek - CNBC - July 28th, 2025 [July 28th, 2025]
- Auterion says it will provide Ukraine with 33,000 AI drone guidance kits - Reuters - July 28th, 2025 [July 28th, 2025]
- How Microsofts customers and partners accelerated AI Transformation in FY25 to innovate with purpose and shape their future success - The Official... - July 28th, 2025 [July 28th, 2025]
- Hawleys bill would let people sue AI firms using their content without permission - STLPR - July 28th, 2025 [July 28th, 2025]
- Western Union to Tap Stablecoins and AI for Greater Efficiencies - PYMNTS.com - July 28th, 2025 [July 28th, 2025]
- Microsoft Edge transforms into an AI browser with new Copilot Mode - The Verge - July 28th, 2025 [July 28th, 2025]
- Forget the Turing Test, AIs real challenge is communication - AI News - July 28th, 2025 [July 28th, 2025]
- Trumps order to remove woke AI from government may have downstream impacts, experts worry - Nextgov/FCW - July 28th, 2025 [July 28th, 2025]
- Google Search: Introducing AI Mode in the UK - The Keyword - July 28th, 2025 [July 28th, 2025]
- AI is driving mass layoffs in tech, but it's boosting salaries by $18,000 a year everywhere else, study says - Fortune - July 28th, 2025 [July 28th, 2025]
- Warren Buffett Has 40% of Berkshire Hathaway's $293 Billion Portfolio Invested in 5 Artificial Intelligence (AI) Stocks - Yahoo Finance - July 28th, 2025 [July 28th, 2025]
- Meta Earnings On Deck. Zuckerberg's Big AI Bets Will Be In Focus. - Investor's Business Daily - July 28th, 2025 [July 28th, 2025]
- Everyone's a loser in Trump's AI Action Plan - Engadget - July 28th, 2025 [July 28th, 2025]
- On GPS: Bill Gates on navigating the future of AI - CNN - July 28th, 2025 [July 28th, 2025]
- AI Apps Are Undressing Women Without Consent And Its A Problem - Forbes - July 28th, 2025 [July 28th, 2025]
- AI's race in the dark with China - Axios - July 28th, 2025 [July 28th, 2025]