Software has become infrastructure for human civilization. But can we truly trust it? Civilization is entering an unprecedented software age.
PROLOGUEIntroduction
Over the past half century, humanity has created countless great software systems: from Unix, C, Lisp, Windows, Linux, Git, the Web, databases and compilers, to today’s cloud computing, big data, artificial intelligence, industrial software, autonomous driving, digital twins and intelligent agents.
These systems are crystallizations of human intelligence. They turn mathematics, logic, engineering, knowledge and experience into forms that machines can execute.
Today finance runs on software; communications are joined by software; power grids are dispatched by software; railways are controlled by software; automobiles are defined by software; factories are organized by software; hospitals are supported by software; cities are governed by software. Artificial intelligence is beginning to give software ever stronger powers of cognition and action.
Software is no longer an auxiliary tool of human society. It is becoming a constituent part of modern civilization itself.
As we hand more and more of the real world to software, have we built a system of trust commensurate with its importance?
The answer, I fear, is not encouraging.
01Behind a RMB 15-trillion software industry lies a vast “trust deficit”
China’s software industry has already grown into an enormous industrial system.
¥15.48 tn2025 software business revenue · +13.2% YoY
¥1.88 tnTotal profit
¥10.64 tnIT services revenue
Software products accounted for RMB 3.24 trillion; industrial software products, RMB 333 billion; information-security products and services, RMB 223.5 billion. This means China already has a software industry on the order of RMB 15 trillion.
Yet we must ask a more basic question: of this RMB 15 trillion in software, how much can truly answer “why it may be trusted”? Traditional software engineering has of course built a great apparatus of quality: programming languages, type systems, compilers, testing, static and dynamic analysis, code review, configuration management, software security, formal verification, DevOps and DevSecOps. These are among the greatest achievements of software engineering.
But as scale and complexity keep rising, a new problem appears: traditional software engineering is increasingly unable, by itself, to bear the full burden of trust for modern systems.
02The greatest danger is not only bugs, but that we do not know whether software is trusted
The traditional software question is usually: are there bugs? Today’s real question has already gone far beyond bugs. We need to ask:
Is the code trusted? Does it correctly implement the requirements?
Is the data trusted? Where does it come from? Is it complete, authentic and current?
Is the software supply chain trusted? Are third-party components safe? Do open-source packages hide unknown vulnerabilities?
Is the knowledge trusted? Is the knowledge the system uses correct? Who defined it?
Are the rules trusted? Are business rules complete? Do they conflict with one another?
Is the model trusted? Why did the model reach this result?
Is the decision trusted? Why did the system take this decision?
Is the action trusted? Why did the agent execute this act?
Is the system trusted? Does the whole still behave as intended in complex environments?
We then see: software trust has expanded from “code correctness” into a systems problem.
03Software complexity has far outrun the old imagination of software engineering
Software once meant a few thousand lines of code. Then tens of thousands. Then millions and tens of millions.
Today a large software system is often not a program but a vast ecology:
Modern software is therefore not a program. It is a complex software system. Further still: it has become a complex socio-technical system.
04Vulnerabilities show that the old trust regime is under severe strain
Data from the U.S. National Institute of Standards and Technology already send a strong signal. From 2020 to 2025, CVE submissions grew 263%. In 2025 NIST handled about 42,000 CVEs.
Into 2026 the pace of submissions is still rising fast. This points to a crucial fact: the speed at which the software world produces problems is approaching—and may exceed—the capacity of traditional human analysis and governance.
This is not the problem of one company, nor of one programming language. It is a structural problem of the age of software at scale.
05The supply chain stretches trust from “one program” to “an entire ecology”
There is almost no truly independent software anymore. A system may depend on hundreds, thousands, even tens of thousands of third-party components. A flaw in one component can travel down the chain.
Verizon’s 2026 Data Breach Investigations Report shows that exploitation of software vulnerabilities has become one of the leading initial attack vectors in data breaches, at 31%. Incidents involving third parties reached 48%.
This means software trust has become a problem of the whole digital ecosystem.
06The economic cost of software failure is already too large to ignore
IBM’s 2025 Cost of a Data Breach Report puts the global average cost of a breach at about USD 4.44 million, and USD 10.22 million in the United States. That is security incidents alone.
If we also count software faults, business interruption, industrial downtime, financial error, medical error, data corruption and supply-chain accidents, the price modern society pays for untrusted software is far greater still.
Software trust is not a quality issue for software firms alone. It is an infrastructure issue for the entire digital economy.
07Artificial intelligence is becoming an important new variable in software trust
This must be stated with care: large models are neither the whole of the trust problem nor its only solution. They are one major technical force now changing software engineering.
Human intent↓Large model↓Code↓Test↓Deploy↓Agent↓Execute
Automatic programming is greatly raising the productivity of software. That is a good thing. It can lower the barrier to building, raise the efficiency of programmers, generate code and tests, analyze code, find some defects, refactor, and write documentation.
Large models may therefore become an important tool of trusted software. But they also raise new questions:
Did the AI correctly understand the requirements?
Does the generated code satisfy the full business semantics?
Is the knowledge the AI used correct?
Did it miss edge conditions?
Does the generated software hide vulnerabilities?
Did the agent exceed its authority?
Is the execution traceable?
AI does not simply “solve” trust. It carries the trust problem into a new stage. It is both a tool of trusted software and a new object that trusted software must govern. That is the accurate position.
08What large models truly change is the software production function
One core bottleneck of classical software engineering is that people write code too slowly. Large models are changing that. Roughly:
PRODUCTION FUNCTION
Software Generation Cost ↓
Software Generation Speed ↑
This is a vast productivity revolution. But the industry contains a crucial asymmetry:
ASYMMETRY
Generating software ≠ verifying software
Once generation capacity rises, verification, testing, audit, understanding and maintenance become more—not less—important. The AI age may therefore obey a new industrial law:
INDUSTRIAL LAW
Generation ↑⇒ Verification Demand ↑
That is an economic foundation of the trusted-software industry.
09The real question is not whether AI can write code, but whether software is worth trusting
These are two different questions. A system may have no obvious bugs, pass its tests and perform well, and still not be trusted—because it may have implemented the wrong requirements.
The future must therefore move from code correctness to intent correctness, and then bring knowledge, rules, decisions and actions all inside the trust regime.
This means software trust is rising from a problem of the code layer to a problem of the semantic layer.
10Palantir reveals another change: software begins to understand the real world
This is the most important reason we study Palantir. What matters is not any single product, but a software idea: AI cannot understand data alone; it must understand the real world behind the data.
Through an ontology it organizes objects, attributes, relations, business rules, actions and permissions. Software thus moves from data-centric toward world-centric. That is a major shift in the software stack of the AI age.
11But merely “understanding the world” is not enough
Here is precisely where China’s trusted-software industry can go further. The next systems must not only answer “what is this?” They must also answer:
12This is the historical opportunity of a Knowledge Operating System
A classical operating system manages CPU, memory, processes, files and devices. The next knowledge operating system must manage entity, event, state, relation, rule, decision, action, trace and evidence.
KOS is not a knowledge base. It is a new software infrastructure for computing, reasoning, deciding, executing and verifying knowledge.
13KOS-TL asks how knowledge enters trusted execution
If knowledge remains a document, a PDF, a vector or a RAG context, trust is still not guaranteed. Knowledge must be able to enter:
Event→Rule→State→Action→Trace
and form executable, verifiable semantics. What KOS-TL explores—
KOS-TL
Event + Rule + State + Execution Trace
—corresponds to a decisive future question: how knowledge becomes part of a trusted computational process. This may become an important piece of the foundational theory of trusted software.
In the end, software verification will move from code verification to knowledge + software + AI + action verification.
15This will give rise to a large new industry
China’s software industry reached RMB 15.48 trillion in 2025. Even at 1% of that whole:
SCENARIO
¥15.48 tn × 1% = ¥154.8 bn
¥15.48 tn × 5% = ¥774 bn
This is not a forecast of future market size. It is a simple penetration scenario. It shows that if trusted software is only a thin value layer inside the software industry, it is still enough to form a space of hundreds of billions—even trillions—of yuan.
Trusted software will also cover AI safety, agent governance, software verification, the software supply chain, knowledge infrastructure, ontology, industrial software, digital twins, trusted operating systems, software certification and software audit.
Trusted software may well become a new foundational software industry of the AI age.
16We must redefine the value of software
VALUE FUNCTION
Once: Software Value ≈ Function
Then: Software Value ≈ Function + Platform
The AI age: Software Value ≈ Function + Platform + Intelligence
The future: Software Value ≈ Function + Platform + Intelligence + Trust
In the end, trust will be an essential part of software’s value.
17We must build China’s own trusted-software industry chain
Not another isolated “security-software industry,” but a complete chain:
A complete system of standards, technology, platforms, tools, software, industries and certification.
18This is not an ordinary industrial question. It is next-generation digital infrastructure
Operating systems were infrastructure of the digital age. So were databases. So was the internet. Cloud computing is becoming infrastructure now.
Today knowledge is becoming a new computational resource, and AI a new computational subject. The future therefore needs a new infrastructure: knowledge infrastructure. Trusted software is an indispensable layer of it.
19We cannot chase only stronger AI. We must also build stronger trusted software
Future competition cannot be only: whose model has more parameters? Whose benchmark is higher? Who has more GPUs? It must also ask:
Who can let AI enter the real world safely?
Who can let agents act in a trusted way?
Who can make software behavior verifiable?
Who can let knowledge enter machine execution?
Who can build a complete software evidence chain?
That is the true next competition in software.
20Why China must take this chance
Because China already has a RMB 15-trillion software industry; a vast manufacturing system; one of the world’s largest bodies of industrial application; a fast-growing AI industry; enormous data and knowledge resources; a complete software chain; and a huge corps of engineers.
What we lack is not the base. What we lack is the strategic capacity to organize that base into next-generation trusted-software infrastructure.
21We cannot be content to remain users of software
In the last software age China long faced a problem: the underlying software infrastructure was in other hands. Today we have a chance to change that.
We must not only use software. We must define software.
We must not only use AI. We must define the trusted mechanisms by which AI enters the real world.
We must not only build data centers. We must build knowledge infrastructure.
We must not only build large models. We must build a trusted intelligent-software system.
22This is the step from a large software country to a strong software country
A large software country means a vast industry. A strong software country means mastery of foundational theory, of core systems software, of standards, of ecosystems, of infrastructure, and of the next software paradigm.
Trusted software may therefore be a decisive opening for a paradigm shift in China’s software industry.
23The historical mission of this generation of software people
Look back: Unix changed operating systems. C changed systems software. Lisp changed the ideas of AI. The Web changed the world of information. Git changed collaboration. LLVM changed compiler infrastructure. Large models are changing how software is produced.
This generation must still answer:
How can software truly understand the real world?
How can knowledge become part of computation?
How can AI use knowledge in a trusted way?
How can agents act in a trusted way?
How can complex software have verifiable behavior?
How can every critical decision be explained, traced and audited?
These are the questions of the age of trusted software.
CODACoda: from “it runs” to “it is worth trusting”
What we face is not a simple upgrade of software. It is a structural change in software civilization.
Once, software helped us compute. Then it helped us connect. Then it helped us manage a complex world. Today software begins to understand the world. Tomorrow it will take part in decisions and act more and more directly on reality.
Software must not only be able to run. It must be worth trusting.
Large models will not solve this by themselves. Neither will classical software engineering alone, nor cybersecurity alone. What we need is a new synthesis:
TRUSTED SOFTWARE
Data + Knowledge + Ontology + Rules + Software + AI + Verification + Execution + Evidence
This is the historical starting point of China’s trusted-software industry.
It is not a negation of the traditional software industry. On the contrary: it is the next layer of value that a RMB 15-trillion industry must now grow.
It is not meant to replace large models, but to make them part of a trusted-software system.
It is not meant to replace classical software engineering, but to raise it into the age of knowledge, AI and the real world.
It is not meant to copy Palantir. It absorbs the ontology and world-modeling idea, and goes further, to a complete trusted computational system:
Knowledge→Reasoning→Decision→Action→Verification
That is the future we should contend for.
Let China move from a large software country to a strong one. From a large AI country to a strong country of trusted intelligent software. Let China possess not only more powerful AI, but the software infrastructure that lets AI enter the real world in a trusted way. Let machines be wiser. Let software be more reliable. Let knowledge be computable. Let intelligence be verifiable. Let action be worth trusting.
This is the age of trusted software. This is the historical mission of our generation of software people.