Automation is changing how organizations work, especially in environments where large amounts of information must be processed, and decisions must be made quickly. Tasks that once required hours of manual review can now be completed in minutes, while artificial intelligence can identify patterns and generate recommendations that help professionals evaluate complex situations.
These advances offer considerable opportunities, but they also raise questions about what happens to human judgment as technology influences more decisions.
Dr. Natalie Callis, founder of LYQOR® and a Human Intelligence Strategist, believes the conversation about automation needs to extend beyond what intelligent systems can accomplish. Her work examines how human performance, judgment, and decision-making change under pressure, including the conditions that shape whether people question, accept, or challenge information presented by technology.
A system may provide an answer faster than a person could reach it independently. However, whether that answer is appropriate for the circumstances may still require human interpretation, contextual understanding, and accountability.
When Efficiency Changes How People Make Decisions
Consider an organization that introduces an automated system to help employees evaluate complex information. Before the technology was implemented, staff may have spent considerable time reviewing details, comparing possible outcomes, and discussing concerns with colleagues.
The new system speeds up much of that process. Employees can receive recommendations almost immediately, reducing the time required to complete routine assessments.
Over time, however, people’s approach to those recommendations may begin to change. Instead of treating an automated output as information to evaluate, they may become accustomed to treating it as the expected answer.
This shift does not necessarily happen because employees lack expertise. When a system performs reliably over time, questioning every recommendation may feel unnecessary, especially as workloads increase and decisions must be made quickly.
Dr. Callis’ work draws an important distinction between using technology to support judgment and letting it replace judgment.
Automation can reduce the effort required to gather and process information. It does not automatically resolve questions about context, competing priorities, ethical responsibility, or the consequences of acting on a recommendation.
The Risk of Trusting a System Too Much
Trust is essential when organizations introduce new technology. Employees need confidence that the systems they use are reliable enough to support their work.
The difficulty arises when confidence becomes an assumption that an automated recommendation is correct simply because the system produced it.
An experienced professional may notice that an output does not fully match the circumstances in front of them. Perhaps an important detail is missing, or the recommendation conflicts with information the professional considers relevant.
In that moment, the person faces a decision that has little to do with operating the technology. They must determine whether their concern is sufficient to question the output, investigate further, or take a different course of action.
That decision can become uncomfortable when the system is seen as highly sophisticated or is strongly endorsed by organizational leadership.
For Dr. Callis, this is where understanding human behavior becomes essential to understanding the risks associated with automation. A person may have the knowledge to recognize a potential problem but hesitate to act on it because of the conditions surrounding the decision.
The concern is not that people should distrust technology. It is that trust should not eliminate the responsibility to exercise independent judgment when circumstances warrant it.
Pressure Can Make Questioning More Difficult
The conditions under which someone receives an automated recommendation can influence how they respond to it.
A professional reviewing information during a quiet period may have time to compare sources, consider alternatives, and investigate anything that appears unusual. The same professional may respond differently when managing several competing demands, facing an approaching deadline, or worrying about the consequences of making the wrong decision.
Under those conditions, accepting a recommendation can feel like the most practical option. It may also reassure someone who feels uncertain.
Pressure can also affect the opposite response. Someone who has already committed to a particular interpretation may reject useful information from an automated system because reconsidering their position would create additional work or uncertainty.
Neither response necessarily reflects a deliberate evaluation of the technology.
Dr. Callis examines these situations through her broader work on human performance under pressure. Her focus includes the internal conditions that affect whether people can access and apply their knowledge, judgment, and decision-making capabilities when circumstances become difficult.
An employee may know that an automated recommendation should be questioned. Recognizing that responsibility and feeling able to carry it out in a consequential moment, however, are not always the same experience.
Human Oversight Requires More Than a Person in the Process
Organizations often emphasize human oversight when discussing responsible AI. Maintaining human involvement matters, especially when automated outputs influence decisions with significant consequences.
But simply assigning someone responsibility for reviewing a system does not guarantee meaningful oversight.
A person may be authorized to challenge a recommendation while working in an environment where questioning the technology is discouraged. An employee may understand the escalation procedure but hesitate to use it because doing so could delay an important process.
Employees may also be unsure who ultimately owns a decision. When a recommendation comes from an automated system, responsibility can become less clear if organizations have not established how employees should evaluate and respond to its outputs.
These concerns show why oversight must be supported by more than policies that describe what employees may do.
People need to understand when intervention is expected, what information should trigger further review, and how responsibility is assigned when human judgment and automated recommendations do not align.
They also need an environment where raising a concern is treated as part of responsible decision-making, not an unnecessary interruption.
Human Intelligence Governance™ and the Responsibility to Question
Through LYQOR®, Dr. Callis is advancing Human Intelligence Governance™, which examines the human judgment, oversight, accountability, and decision integrity required to govern intelligent technologies responsibly.
This work addresses a dimension of AI governance that often gets less attention than technical safeguards. While organizations establish controls for how intelligent systems are developed, monitored, and deployed, people remain responsible for interpreting outputs and deciding when intervention is necessary.
This introduces questions that technical performance measures alone cannot answer.
What happens when an employee recognizes a concern but feels pressured to accept an automated recommendation? How does an organization respond when a professional challenges a system that has consistently produced reliable results? Are employees prepared to exercise judgment when the technology provides an answer that appears convincing but does not fully account for the circumstances?
These situations involve human responsibility as much as technological capability.
Dr. Callis’ approach does not position Human Intelligence Governance™ as a replacement for technical AI governance. Instead, it extends the discussion to the conditions that affect how people fulfill their oversight responsibilities.
The distinction matters most in consequential environments where automated recommendations may influence decisions involving healthcare, organizational leadership, behavioral risk, or other matters that require careful human evaluation.
Accountability Cannot Be Automated Away
As technology becomes more capable, organizations may begin relying on automated systems for increasingly complex tasks. This can create efficiencies, but it can also make responsibility harder to understand when several people and systems contribute to a decision.
An employee may act on a recommendation generated by technology that was selected, configured, and approved by others. If the outcome is questioned, determining who was responsible for evaluating the recommendation can become complicated.
Responsible governance requires organizations to address those questions before a difficult situation occurs.
Employees should know which decisions require independent review, when to escalate concerns, and who can override an automated recommendation. Those responsibilities need to be practical and understood, not just written in policy documents.
Accountability also depends on whether people can genuinely fulfill the responsibilities assigned to them.
If an organization expects employees to challenge automated outputs but gives them little time, insufficient information, or limited support, a human reviewer may offer less protection than intended.
For Dr. Callis, therefore, the quality of oversight must be considered alongside the human conditions under which it takes place.
Preparing People for Decisions Technology Cannot Make for Them
Introducing automation usually involves teaching employees how to operate a new system. They learn its functions, understand its intended uses, and become familiar with the information it provides.
Dr. Callis believes organizations should also consider how people will respond when the system produces something unexpected or when its recommendation conflicts with their professional judgment.
That preparation may involve examining how employees respond to uncertainty, whether they recognize when pressure is influencing their decisions, and how they communicate concerns when the consequences of challenging a recommendation feel significant.
It may also require organizations to revisit the expectations they create around speed and efficiency.
When employees are consistently rewarded for completing tasks quickly, taking extra time to investigate an unusual output may feel at odds with what the organization values. Without clear support for appropriate questioning, the pressure to maintain efficiency can undermine the judgment that human oversight is intended to provide.
These concerns connect Human Intelligence Governance™ with Dr. Callis’ broader Perform Under Pressure™ work. Both examine what happens to human judgment as circumstances become more demanding and how people can keep making deliberate decisions.
Keeping Human Judgment at the Center
Automation’s value does not depend on removing people from every decision. In many environments, its greatest contribution may be allowing professionals to spend less time processing routine information and more time examining matters that require human understanding and responsibility.
Achieving that benefit requires organizations to think carefully about the relationship between technology and the people who use it.
An automated recommendation can be accurate but not appropriate in every circumstance. A system can perform consistently while the people overseeing it experience changes in workload, confidence, attention, or their willingness to challenge its conclusions.
These are among the human factors Dr. Callis believes organizations must consider as automation becomes more deeply integrated into consequential work.
Technology may continue to improve how quickly information is processed and how efficiently recommendations are generated. Questioning those recommendations, recognizing their limitations, and determining when intervention is necessary remain essential parts of responsible decision-making.
For organizations adopting increasingly intelligent systems, the challenge is not simply to build better technology. It is to ensure that the people responsible for using and governing that technology can still exercise sound judgment when it matters most.
About Dr. Natalie Callis
Dr. Natalie Callis, DNP, NEA-BC, is a PhD candidate and doctoral researcher examining human performance under pressure. She founded LYQOR® and is a Human Intelligence Strategist whose work examines human performance, judgment, and decision-making under pressure. With more than 25 years of experience in healthcare leadership and high-stakes environments, she develops research-informed frameworks that explore what happens internally when pressure begins to affect performance. Her work spans leadership, healthcare, sports, behavioral risk, education, and the governance of emerging technologies.
About LYQOR®
LYQOR® is the company and intellectual architecture behind Dr. Natalie Callis’ work on human performance and judgment under pressure. Its research-informed frameworks have applications across leadership, sports, artificial intelligence, behavioral risk, healthcare, education, and other consequential environments. Human Intelligence Governance™ extends this body of work to the human judgment, oversight, accountability, and decision integrity required to govern intelligent technologies responsibly.
Connect with Dr. Natalie Callis:
- LinkedIn: Dr Natalie Callis
- X: @DrNatalieCallis
- TikTok: @drnataliecallis
