Treat the Agent as an Embedded Worker in the Ecosystem

Episode Summary

A contract describes how two companies agreed to work, and Randy Friedman, chief commercial officer of Cognizer, thinks it is time to stop checking on that with a monthly report. His company turns contract documents into structured data, and agentic flows now build the extraction models rather than engineers training them by hand. The interesting part starts where his own product stops. Enforcing an agreement continuously means seeing inside a supplier’s systems as they run, which is where his embedded worker comes in: an agent with access to the data it needs and no more. What stands in the way is the data rather than the models. Today’s infrastructure assumes one organization and one administrator, and this needs decentralized control, work at the edge, and governance from the bottom up. The fabric for it does not exist yet, and his argument for why it will is that supply chain people have had it on their minds for a while.

Key takeaways

The history he runs through is the useful part of the answer. The conventional approach was training models with training sets and aiming them at the problem, which evolved into using large language models and generating prompts for them

  • His definition of contract intelligence is concrete enough to steal. Take contract documents, extract intelligence from them, structure it, graph it and generate insights and analytics, so an organization understands its commercial relationships, obligations and revenue opportunities

  • The reason one model cannot serve every customer is the phrase he keeps returning to. A contract is a data type, the aggregation of a company’s millions of them is a data space, and no two companies have the same one, so each needs its own intelligence to resolve it

  • He is careful about what large language models contribute, which is unusual for a vendor. Large language models provide some of the modeling a contract data space needs, he says, but not all of it

  • What changes with agentic flows is who does the assembling. Instead of prompting the model, you create a team of agents, give them assignments and something close to an anthropomorphic personality, and they do the work of building the AI

  • The line that gives the episode its shape is one sentence. They become the AI that builds the AI, and what a customer supplies is not the words to look for but the legal concepts and the meaning, after which the models get built automatically

  • The constraint he names is the hinge of the whole conversation. You can only really train models, even with agentic flows, on data that you control, which is fine until the work needs data the organization does not possess

  • He sizes the ecosystem by the supply chain, having just said this part is beyond what Cognizer works with today. The companies a business contracts with are in its supply chain and value chain, and he expects the business to end up deeply embedded inside those organizations from a data and AI point of view

  • His worked example turns a contract from a document into a control loop. A supply agreement sets quality, cadence, availability and inspection, and analyzing that contract is one thing while enforcing it is another

  • The status quo he is arguing against is a monthly report, and he is specific about why it fails. A spreadsheet or a periodic report is too slow to optimize against, so the buyer needs a dynamic flow of the data that report was made from

  • He hedges his own claim rather than overselling it. AI makes this possible to do dynamically, and he would not say in real time, but continuously, with the cadence set by how fast the opportunity is moving

  • His one-line history of information exchange lands the point. He calls permeable perimeters the natural continuation of a sequence he has just run through: fax machines, an emailed spreadsheet, a shared table both parties work in, then sensing built into an ERP

  • Asked whether this is an agentic workflow API, he reaches for people instead. At a high level it is an embedded worker, or a team of workers, allowed inside your organization but not free to run amok

  • His access rule is a tight definition of least privilege. The data has to be available to the agent, but not necessarily visible or useful in any way other than its intended purpose

  • He puts the same shape on two industries that have nothing to do with supply chains. One patient seen by multiple doctors in different facilities with different systems needs a continuum of care, and drug discovery runs the same patients through different clinics inside different trials

  • His summary of the arc is the compact version of the whole problem. It goes from producing training data to train a model, to prompting a large language model and doing retrieval on your own content, to agentic analysis across multiple datasets, not all of which he has permission to use or to create

  • The diagnosis is architectural rather than technical. Today’s data infrastructure is organization-centric with an administrator who delegates roles and access, built up from the conventional database, and it was never designed for cross-organizational engagement

  • The first requirement he names comes from blockchain, with its performance left behind. He calls decentralized control through smart contracts a totally different kind of structure, and says it does not scale very well, so what is needed is decentralized entitlement without blockchain’s performance cost

  • The second requirement is physical. The more computationally complex the work, the closer to the data it has to run, so gathering everything in one place to analyze stops working once the work gets complex

  • The third requirement inverts how governance is usually built. Fiduciary, legal and regulatory obligations mean you cannot have a centralized governance structure, and it has to work from the bottom up at the data level rather than top down at the organizational level

  • He is describing something that does not exist and says so plainly. Those kinds of things do not exist right now, and what is needed is a new fabric connecting organizations in a secure way, federated and decentralized in its entitlements, so each organization controls what data is used, how, by whom, and by which agent

  • His own company already runs a version of the trust problem. Cognizer is asked to build models and AI capabilities that understand a customer’s contract data space without ever being allowed to see it, which he calls an interesting trick

  • He names the tension without pretending it is solved. People in his and the host’s shared network have put their models behind the firewall to protect their customers’ data, which he says sets an upper limit on what they can do

  • On whether change comes from the business or the technology, he says both, and the cloud is his evidence. The cloud solved a technical problem of scalability, redundancy and economy, virtualization is what made it possible, and only once people had it did they push it up to the application level and get the collaboration they had always wanted

  • His analogy for repurposed technology is a drug developed for one thing that turns out to do another. He expects reuse of technology people did not think was good for a particular purpose, the way a blood pressure drug turned out to grow hair

  • He accepts the host’s framing that new kinds of companies force the issue, and extends it. The evolution will drive new enterprises and new providers, and he points at large language models being productized as virtual workers you hire and pay by the month

  • He draws a distinction between two kinds of agent negotiation, and notes in the same breath that Cognizer is not doing the negotiation case. Two agents representing two parties sit outside each other’s security perimeters with no overlap; doing the business activity the contract describes is what forces the perimeters to overlap

  • His answer on what executives should do starts with the demand already inside their own teams. If you run procurement or manage a supply chain, he says, making it more performant, more observable and more controllable is already on your mind, and the data your work depends on already belongs to somebody else

  • His closing idea is that most of what is coming is old ideas coming back, and he has a name for it. Bell bottoms: concepts from earlier technology implementations reimagined and repurposed with more power, and he tells enterprise leaders to ask the big questions that follow from it

  • The example he ends on is a company of people, not software, which is the point. Deloitte’s few hundred thousand people work inside their customers’ perimeters and effectively become embedded workers, and his question is how you make that happen with AI

About Randy Friedman

Randy Friedman is chief commercial officer of Cognizer, which applies AI to legal business processes and specializes in contract intelligence: taking contract documents, extracting the intelligence in them, then structuring and graphing it into insights about commercial relationships, obligations and revenue opportunities. He describes the company as working in what he calls somewhat of a double-blind, building models and AI capabilities that understand a customer’s contract data space without ever being allowed to see it. His argument on this episode reaches past that work: once agents are treated as embedded workers, the constraint stops being the model and becomes the data, because the data an enterprise needs often belongs to its ecosystem partners rather than to itself.

 

In this episode

00:58 Welcome, and who Randy Friedman is
01:35 The opening question: using AI to build AI
01:46 A continuum of technology development
01:51 What contract intelligence extracts, and what it is for
02:32 The contract data space, and why no two companies share one
02:57 What large language models provide, and what they do not
03:26 Agentic flows: a team of agents with assignments
03:57 They become the AI that builds the AI
04:36 The constraint: you can only train on data you control
04:58 Data you need but do not possess, and the ecosystem beyond Cognizer
05:27 The supply chain, the value chain, and the next horizon
05:46 Checking the claim: data from another organization
06:35 A supply contract as quality, cadence and availability
07:27 Why the monthly report is not good enough
08:40 Not real time, but continuous, at the cadence the opportunity needs
09:19 A natural continuation, and permeable perimeters
09:40 Is this an agentic workflow API?
09:45 The embedded worker, let inside and not free to run amok
10:07 Available data, not visible beyond its purpose, and the gray area growing
10:27 Healthcare, and one patient across many systems
10:48 Drug discovery, and the same shape of problem
11:20 The whole arc: training data, prompting, agentic analysis
12:00 A different infrastructure for the data
12:34 Why today’s infrastructure is organization-centric
12:58 Where it came from, and what blockchain did differently
13:21 Why it does not scale, and control held by the owner
13:47 Utilization across organizations, and tolerance for latency
14:12 Computational complexity, the edge, and the third issue of trust
14:37 Governance from the bottom up at the data level
15:01 A new fabric that does not exist yet
15:43 Who controls what, how, by whom, and by which agent
15:57 A fundamental change in how data can be used
16:05 Somewhat of a double-blind, in his own words
16:13 Building models for contract data they are never allowed to see
16:35 Why nobody has done it, and what agentic architectures change
17:01 Models behind the firewall, and the limits that sets
17:53 New technology as a chance to re-architect what you already have
18:47 Or does it come from the technology outward?
19:09 Chicken and egg, and what the cloud actually solved
19:42 Virtualization, then collaboration nobody had a method for
20:32 The forward-thinking operator, and the goal that pulls technology along
20:56 COVID as the lesson, and the reuse nobody expected
21:35 People invent new kinds of companies with new technology
21:49 The one-person company where agents do everything else
22:28 New enterprises, and models productized as virtual workers
23:08 One entity is one level of complexity, more than one is another
23:29 Two agents negotiating, with no overlap between them
24:16 Doing the business the contract describes, and overlapping perimeters
24:37 Guidance for executives getting ready
24:56 The people who have been thinking about this all along
25:22 Data that belongs to somebody else, and the vendors who will come
26:10 Resources
26:19 Medium, and Steve Jones at Capgemini
27:17 What listeners should take away
27:34 Bell bottoms, and old ideas coming back with more power
28:24 Deloitte’s people as embedded workers, and the same pattern for AI
29:32 Close

In Randy’s words

“They become the AI that builds the AI.”

Randy Friedman   (03:57)

“you can only really train models, even with agentic flows, on data that you control”

Randy Friedman   (04:36)

“the perimeters are becoming permeable to these organizations”

Randy Friedman   (09:19)

“At a high level, it’s like an embedded worker.”

Randy Friedman   (09:45)

“you have to make sure that data’s available, but not necessarily visible or useful in any way other than its intended purpose”

Randy Friedman   (10:07)

“You almost have to have a governance structure that works from the bottom up at the data level, not at the top-down organizational level”

Randy Friedman   (14:37)

“We’re being asked to help companies develop models and AI capabilities to, to understand their contract data space, but not ever see it.”

Randy Friedman   (16:13)

“Old concepts from old kinds of technology implementations are being reimagined and repurposed in new ways.”

Randy Friedman   (27:34)


 

Resources

Ideas and terms discussed

  • The contract data space: His term for the whole of an organization’s contracts treated as one body of data rather than as documents. It is the reason one model cannot serve every company: the space is different at every company, so each needs its own intelligence to resolve it

  • AI that builds the AI: His compression of what changes with agentic flows. A team of agents with assignments builds the extraction models, from a description of the legal concepts a customer wants captured rather than from a list of words

  • Agentic flows: His name for the generation after prompting. Rather than asking a large language model for answers, you give a team of agents assignments and something close to an anthropomorphic personality, and let them do the work

  • The embedded worker: The metaphor that carries the episode. An agent working inside another organization’s systems, allowed in deliberately, with access to the data it needs and no ability to run amok

  • Permeable perimeters: His description of where enterprise boundaries are heading. Information exchange went from fax to emailed spreadsheet to a shared table to sensing inside an ERP, and agents crossing organizational lines is the next step in the same sequence

  • Decentralized entitlement: What he takes from blockchain without taking its performance. Control over how data is used stays with its owner, while the use of that data happens across organizations, which is the opposite of how databases delegate access today

  • Governance from the bottom up: His answer to the trust problem. Because fiduciary, legal and regulatory obligations sit with the data owner, governance has to be applied at the data level rather than at the top-down organizational level

  • The edge, and latency: The physical constraint on all of it. Richer agentic work tolerates less latency, so the more computationally complex it is, the closer to the data it has to run, which is why gathering everything in one place to analyze stops working once the work is complex

  • Double-blind delivery: How his own company already works. Cognizer builds models that understand a customer’s contract data space without ever being allowed to see the contracts

  • Bell bottoms: His closing metaphor for what is coming. Old concepts from earlier technology implementations, reimagined and repurposed with more power, which is what he tells enterprise leaders to ask big questions about

Named on air

Related AI Realized episodes and events

 

Frequently Asked Questions

 
 
 
 
 
 
 
 
 
 
 
Previous
Previous

Bridging Data Science and Generative AI

Next
Next

Write the AI Policy Before You Write the AI Feature