Privacy and computation have always had an uneasy relationship: traditional encryption locks data away safely, but the moment a system needs to actually use that data, the lock has to come off. Homomorphic encryption upends that assumption entirely. This episode of Automatic explores the technology that makes encrypted computation possible — and what it means for any organization that processes sensitive information across systems it doesn't fully control.

The episode covers the core mechanics of homomorphic encryption, how it differs from conventional approaches, and what's holding back broader deployment. Key points include:

• Where traditional encryption falls short: Standard encryption protects data at rest and in transit, but requires data to be decrypted before any computation can run — and that brief window of exposure is where many security failures originate.
• How homomorphic encryption works: Encrypted data retains enough mathematical structure for approved operations to be performed on it directly, so an external processor can return a correct, meaningful result without ever accessing the underlying plaintext.
• Three tiers of the technology: Partially homomorphic schemes support a single operation type; somewhat or leveled homomorphic schemes handle both addition and multiplication up to a defined complexity ceiling; fully homomorphic encryption (FHE) supports arbitrary computation with no ceiling — at a steep performance cost.
• The noise problem: Each encrypted operation accumulates internal mathematical distortion. Left unmanaged, this "noise" can make a ciphertext impossible to decrypt correctly, and handling it carefully is a core engineering challenge in the field.
• The case for outsourced computation: Homomorphic encryption allows one party to delegate processing to a third party without revealing readable data — a meaningful shift for organizations that rely on distributed infrastructure or cross-boundary data collaboration.
• Performance as the honest obstacle: Encrypted operations can be dramatically slower and more memory-intensive than their plaintext equivalents. The technology isn't suitable for every workload, but hardware acceleration and more efficient schemes have been steadily narrowing the gap.

The broader argument the episode makes is philosophical as much as technical: privacy shouldn't have to step aside the moment useful work begins. As the engineering matures, the range of workloads where homomorphic encryption makes practical sense will continue to expand. For more on this topic, explore the source article this episode is based on. If the intersection of privacy and AI is on your radar, the episode Private LLMs and the End of Audit Season Dread is a natural companion listen.

Automatic

Compliance reviews have long been defined by last-minute data hunts, fragmented systems, and the kind of late nights that no amount of emergency snacks can fix. This episode of Automatic examines why that pain is largely a structural problem — and how private large language models are offering a credible alternative. Drawing on this in-depth look at private LLMs and audit readiness, the episode unpacks the architecture, the practical workflow changes, and the strategic shift from reactive firefighting to proactive governance.

Here's what the episode covers:

• The root causes of audit chaos — fragmented data silos, statistical sampling blind spots, and the persistent loss of why decisions were made, not just who made them and when.
• How private LLMs work as compliance infrastructure — deployed entirely on company servers behind the firewall, these models stitch policies, approvals, tickets, and transactional records into a single, queryable semantic layer.
• Immutable interaction ledgers — every query and system response is hashed and time-stamped to an append-only log, making gaps as visible and auditable as the records themselves.
• Role-based access and auto-generated evidence packs — fine-grained permissions ensure each team sees only what they should, while the model automatically assembles the documents and cross-references needed to satisfy specific control objectives.
• Continuous control testing — rather than a once-a-year point-in-time review, the model compares daily activity against frameworks like SOC 2 or ISO 27001 in real time, flagging deviations the moment they appear and logging remediation steps with full context.
• Explainability as a compliance asset — outputs cite specific policy clauses and source data in plain language, giving auditors and legal teams the transparent reasoning chain that turns AI-assisted work into a governance strength rather than a liability.

The episode also touches on the human dimension: teams freed from weeks of frantic documentation prep are less error-prone and easier to work with — a practical operational benefit that compounds over time. The broader argument is that the organisations investing now in private AI infrastructure aren't just smoothing out audit season; they're building durable operational trust that extends well beyond any single review cycle.

More from the show: if you enjoyed this episode, check out Agentic AI Is Reshaping the Energy Grid — Here's How for another look at how AI is transforming high-stakes, regulated industries.

LLM

The energy and utilities industry runs on relentless, high-stakes decision-making — and most of it happens across systems that were never built to work together. This episode of Automatic examines why agentic AI is gaining traction in this sector faster than almost any other, drawing on the full research report on agentic AI for energy and utilities to map the market, the operational pressures, and the real-world use cases driving adoption.

The episode covers the full arc — from the market numbers to the on-the-ground reality of where agents are already showing up in utility operations:

• A market being built in real time: Global AI spend in energy and utilities is projected to grow from roughly $13–15 billion in 2023 to $80–100 billion by 2030, with agentic AI specifically growing at 35–45% annually.
• Three converging pressures: A quarter of the U.S. utility workforce is approaching retirement, renewable energy is increasing grid volatility, and aging infrastructure is being replaced too slowly — creating an industry that doesn't just want automation, it needs it.
• The three-stage shift: The industry is moving from SaaS systems of record, through AI-assisted workflows, and into the third stage — agentic systems that can plan, execute, and adapt across entire workflows with minimal hand-holding.
• Where agents land first: The practical first wave isn't "AI runs the grid" — it's agents handling outage triage, predictive maintenance workflows, regulatory filings, crew dispatch recommendations, and demand response coordination, with humans retaining accountability.
• Multi-agent systems as the real unlock: In complex environments like distributed energy and grid operations, layered agent architectures — where separate agents handle forecasting, monitoring, market participation, and compliance in parallel — consistently outperform single-model deployments.
• The actual bottleneck: Data integration, not model performance or compute, is what determines success or failure. Unifying SCADA, IoT, and enterprise data is the strategic foundation everything else depends on.

The episode closes with a practical framework for organizations ready to move beyond pilots: start with high-frequency, repetitive decisions; invest in orchestration over models; build internal capability to supervise and refine agent behavior; and design for gradual autonomy rather than attempting full automation on day one. More from the show: listen to The Enterprise Knowledge Loop: Capture, Train, Automate for a deeper look at how organizations build the internal knowledge infrastructure that makes agentic systems work.

Automatic

Agentic AI is moving from a buzzword on roadmaps to a structural force in enterprise software — and the numbers behind the shift are hard to ignore. This episode of Automatic digs into the research behind the full AI and SaaS market analysis, tracing what happens when software stops waiting for clicks and starts completing work on its own. The core argument: we are not watching a feature cycle. We are watching the fundamental bargain of SaaS get rewritten.

The episode covers the forces reshaping enterprise software and where the real opportunity — and real risk — sits right now:

• The scale of the shift: Agentic AI appeared in less than 1% of enterprise apps in 2024; Gartner projects 33% by 2028, with the AI agents market forecast to grow from roughly $8 billion in 2025 to over $52 billion by 2030.
• The new SaaS bargain: Traditional software handed users a dashboard and waited for input. Agentic software understands a goal, breaks it into steps, calls the tools it needs, and either finishes the task or escalates when the stakes are high — shifting the interface from screens to outcomes.
• Where early traction is concentrating: Customer support, developer productivity, IT service management, and sales and marketing operations are the four segments with the clearest unit economics and the most structured tooling — making them better starting points than broad transformation plays.
• The specificity advantage: Across every vertical, narrow agents outperform generic ones. An invoice exception agent is more deployable and more trusted than an all-purpose AI finance assistant.
• Why more than 40% of projects may fail: Gartner's warning that a large share of agentic AI initiatives could be canceled by 2027 points to predictable failure modes — workflows that are too broad, underestimated inference costs, and autonomy treated as a goal rather than a calibrated dial.
• The incumbent SaaS dilemma: Established platforms face a genuine tension — agents could abstract away their interfaces, but they also own the workflow data, permissions, and customer relationships that agents depend on, giving them real leverage if they act early enough.

The strategic takeaway the episode lands on: the companies that will matter when the 33% forecast arrives are the ones building specific, measurable, guardrail-first agents today — not the ones chasing the most ambitious autonomy story. For more on this theme, listen to The Boring Middle: Agentic AI in Media, Education, and the Public Sector, which explores how agentic AI is taking hold in sectors where the hype is quieter but the stakes are just as high.

Automatic

Workforce turnover quietly drains the reasoning, judgment, and hard-won instincts that make organizations effective — and most companies have no systematic way to stop it. This episode of Automatic explores the Enterprise Knowledge Loop framework for capturing and operationalizing institutional knowledge, a perpetual three-phase cycle designed to transform the expertise locked inside people's heads into durable, actionable intelligence before it walks out the door.

The episode walks through each phase of the loop in depth, examining what makes each one work — and what causes it to fail. Key topics covered include:

• Why linear knowledge management fails: Static wikis and PDF handbooks become outdated the moment they're published; the loop model is self-refreshing by design.
• Frictionless capture at the source: Meeting transcribers, voice-note bots, and browser-based clipping tools harvest tacit knowledge passively, so even the busiest subject-matter experts contribute without breaking their flow.
• Governance baked in from day one: Cryptographic fingerprinting, sensitivity classifiers, and automated policy routing ensure contributors trust the system — because trust is what keeps the faucet open.
• Curated training over bulk ingestion: Relevance scoring, deduplication, and human microtask review keep the fine-tuning corpus lean and accurate, while tying performance gains to concrete business outcomes rather than abstract model metrics.
• Automation that integrates invisibly: Embedding AI outputs inside tools teams already use — Slack, pull-request workflows, ticketing systems — drives adoption without forcing behavioral change, while guardrails prevent runaway processes from eroding executive trust.
• Telemetry as the loop's fuel: Every accepted suggestion, edit, and dismissal feeds back into the training cycle, so the system compounds in value with each revolution rather than plateauing.

The episode also addresses the cultural layer that determines whether the tooling actually takes hold: leadership recognition, performance incentives tied to knowledge contributions, and the small rituals that signal organizational commitment to the loop. The payoff is concrete — ticket resolution times, onboarding durations, and rework rates all shift measurably — but the deeper prize is an organization whose collective intelligence no longer depends on any single person staying.

For more on how AI strategy intersects with organizational infrastructure, listen to Why Data Residency Laws Are Accelerating Private AI Adoption. More from LLM.

Data sovereignty legislation is quietly becoming one of the most powerful forces in enterprise technology. This episode of Automatic draws on this deep-dive on data residency and private AI adoption to unpack why a wave of cross-border data regulations is fundamentally changing where — and how — companies choose to run AI workloads. What began as a compliance concern for a handful of regulated industries has grown into a boardroom-level strategic priority with real financial teeth.

The episode walks through the full chain of cause and effect, from the legal landscape to the infrastructure renaissance to the talent market shifts it's all producing:

• The legal acceleration: Data sovereignty statutes are proliferating on nearly every continent, with enforcement agencies moving faster and penalties scaling to company revenue — making regulatory exposure a first-order financial risk.
• The trust crisis in public cloud: Even regionally hosted cloud services often fail to satisfy data residency requirements, because the questions go beyond server location to ownership, foreign legal compulsion, and multi-tenant exposure.
• A hardware renaissance: On-premise infrastructure once written off as legacy is back in demand — liquid-cooled racks, sovereign-ready GPU clusters, and private facilities are seeing new investment as organizations localize AI workloads.
• Privacy as engineering discipline: Techniques like federated learning, differential privacy, synthetic data generation, and confidential computing have moved from research papers into production requirements.
• New hybrid roles and "Deplomacy": The talent market is rewarding professionals who can bridge legal compliance and technical deployment — a convergence of DevOps and data governance that the industry is only beginning to formalize.
• Users and open source as co-drivers: Consumer awareness of data residency is turning server location into a marketing differentiator, while open source communities are lowering the compliance cost curve for smaller organizations.

The episode closes with a reframe that will resonate with engineers and executives alike: data residency regulations aren't obstacles to route around — they're design constraints, and the companies treating them that way are already building more resilient, trusted AI infrastructure than those still waiting for the rules to ease up. For more on how AI is playing out across different sectors, check out The Boring Middle: Agentic AI in Media, Education, and the Public Sector.

LLM

Fifty-four billion dollars flowed into AI across media, education, and the public sector in 2024 alone — and yet the people inside those organizations aren't asking for smarter models. They're asking for help finding the right document, writing the first draft, and routing it to the right person. This episode of Automatic explores the case for agentic AI in media, education, and the public sector and argues that the real market opportunity isn't the dramatic, autonomous stuff — it's the slow, repetitive, clerical work that surrounds every expert decision.

Here's what the episode covers:

• Copilots vs. workflow agents: Why the first wave of AI tools helped individuals write faster, and why the next wave is about moving work across entire organizations — with audit trails, routing, and structured handoffs.
• Why these three sectors belong together: Newsrooms, universities, and public agencies all run on knowledge work that has to be trusted, making the "replace humans with bots" framing not just wrong, but a fast way to lose buyer confidence.
• Sector-by-sector breakdown: From archive monetization and content localization in media, to advising triage and accessibility support in education, to citizen-service workflows in government — the episode maps the specific bottlenecks where agentic AI earns its keep.
• The market numbers: The global AI agents market is projected to grow from roughly $8 billion in 2025 to over $52 billion by 2030, with the serviceable wedge for media, education, and public sector workflows estimated between $85M–$140M in 2025 and approaching $1 billion by 2030.
• Where the real moat is: Model access is no longer a differentiator — the organizations that win will own the full sequence from request to reviewed output, including workflow memory, integrations, evaluation data, and trust.
• How to sell into cautious buyers: These sectors don't buy vague autonomy. They buy named workflows, baseline metrics, clear control points, and a calm rollback plan — outcomes framed as relief, not replacement.

The episode closes with a reframe worth holding onto: the organizations best positioned to benefit aren't asking "how do we use AI?" — they're asking "where does work get stuck, and what would it feel like if it moved?" That's where the value hides. More from the show: From PDF Hell to Structured Insights with Local LLM Pipelines explores another angle on putting AI to work on real organizational data.

Automatic

Anyone who has stared down a sprawling, scan-heavy PDF and been asked to extract meaningful data from it knows the quiet despair that follows. This episode of Automatic examines a practical, end-to-end solution drawn from this deep-dive guide on taming PDFs with local LLM pipelines — a four-stage architecture that takes documents from raw, malformed chaos to clean, queryable knowledge, entirely on-premises.

The episode covers why PDFs are structurally deceptive, why naive extraction almost always fails, and how each stage of a well-designed local pipeline addresses a specific failure mode. Key topics include:

• Why PDFs are uniquely treacherous: Scanned documents carry no true text layer, OCR output can be wildly unreliable, and embedded tables are among the most difficult data-extraction challenges in everyday analytical work.
• Stage 1 — Extraction: Structure-aware parsers paired with high-resolution OCR engines can detect low-confidence regions, apply adaptive thresholding, and flag genuinely resistant content for manual review rather than silently corrupting downstream data.
• Stage 2 — Chunking: Splitting text at fixed token counts breaks meaning; a smarter approach preserves syntactic boundaries, uses overlapping sliding windows, and tags every chunk with page, section, and content-type metadata.
• Stage 3 — Vector indexing: Text chunks are converted to embeddings that cluster by semantic meaning, enabling fast, relevance-ranked retrieval from a local database — no third-party API involved, and incremental updates keep the index current without a full rebuild.
• Stage 4 — Question answering and automated tagging: A lightweight classifier labels chunks with topics, entities, and dates for structured filtering, while a generative model assembles focused answers from the most relevant retrieved context, complete with confidence scores and source citations.
• Security as a design principle, not a feature: Every stage runs within the user's own infrastructure, making the pipeline suitable for regulated industries and any workflow where data confidentiality is a hard requirement rather than a preference.

The episode also highlights how a built-in feedback loop — where user corrections flow back into the system — allows the pipeline to improve continuously over time, tuning itself to the specific shape of an organisation's document corpus and the real-world needs of its analysts.

For more on how AI is changing the nature of knowledge work at a broader level, check out the episode The New Work Layer: How Agentic AI Is Reshaping the Workforce. More from LLM.co.