Image
Why Automotive Software Can Pass Verification and Still Fail in the Field
by Acsia Web
Software-defined vehicle architecture: a central controller connected to ECUs and networks across the vehicle

A software change can satisfy the requirement it was created to fix and still create a new vehicle-level risk.

That is what made a 2025 Volvo recall particularly instructive. The U.S. National Highway Traffic Safety Administration warned owners of certain plug-in hybrid and battery-electric models about a potential loss of braking after an earlier over-the-air recall remedy. The first software update had been issued to address rear-view-camera failures; NHTSA said the later braking defect originated from that remedy.

The lesson is bigger than one recall. In a software-defined vehicle, a change does not necessarily remain confined to the requirement that triggered it. Vehicle behavior emerges through software, ECUs, networks, hardware configurations and other functions operating together—which is why modern V&V increasingly uses software, system, SIL/MIL/HIL and vehicle-level testing rather than relying on a single test layer.

For OEMs and Tier 1 suppliers, that changes the quality question.

The question is no longer simply: “Did this release pass verification?”

A more useful question is: “Do we have enough connected evidence to trust what this change will do in the vehicle?”

Verification, validation and assurance answer different questions

Verification asks whether the implementation satisfies specified requirements. Validation asks whether the integrated system is fit for its intended use and behaves appropriately in the conditions for which it is intended. Assurance asks whether the processes and evidence supporting those conclusions are controlled, traceable, and trustworthy.

They are related questions. They are not interchangeable.

Automotive SPICE 4.0 reflects that distinction structurally: software verification is addressed through software engineering processes including SWE.4, SWE.5 and SWE.6. Validation is represented separately by VAL.1; and Quality Assurance by SUP.1.

That matters because passing a test is not the same as understanding the full effect of a change.

A test provides evidence for the conditions, inputs, and expected outcomes it covers. But a software change that behaves correctly at component level can encounter different interactions after integration, across another configuration or under an operating condition outside the original regression scope. SIL, HIL and vehicle testing exist in part because different levels expose different classes of behavior.

The answer, therefore, is not simply more tests.

It is better continuity between what changed, what could be affected, what was tested, what was not tested, what failed and why the remaining risk is acceptable for release.

The assurance gap often sits between test levels

Most mature automotive programs already generate substantial test evidence.

Software-level verification can expose logic and interface problems early. SIL can increase test speed before target hardware is available. HIL introduces ECU, network and hardware interaction. System and vehicle validation exposes behavior that only emerges as functions operate together. Current automotive V&V strategies increasingly combine these environments with automation and continuous-testing pipelines.

But each level can be successful individually while assumptions between the levels remain insufficiently challenged.

Release confidence comes from connecting them.

This becomes particularly important when software continues changing after SOP. UN Regulation No. 156 establishes requirements for vehicle software updates and Software Update Management Systems, making disciplined, controlled software change a lifecycle concern rather than only a development-phase activity.

Five signals your V&V system may be generating test evidence without release confidence

Five signals your V&V system may be generating test evidence without release confidence
  • Signal 1: Regression scope follows mainly what changed in the code
    The edited component is only the starting point. Impact analysis should also consider affected interfaces, states, dependencies, configurations and vehicle functions.
  • Signal 2: Requirements, tests, results and defects exist in separate views
    When the evidence chain has to be reconstructed before a gate or assessment, the program may know what was tested without being able to demonstrate quickly why that testing was sufficient.
  • Signal 3: SIL, HIL and vehicle testing operate as handoffs
    Each test level can pass while an assumption transferred to the next level remains unverified. Evidence and unresolved risk should travel with the software.
  • Signal 4: Failed tests receive more attention than untested conditions
    Known defects are visible. Missing scenarios, variants or combinations can remain invisible until integration—or the field—exposes them.
  • Signal 5: Release readiness is driven primarily by pass rate
    A high pass percentage does not establish confidence if important configurations, interfaces or operating conditions remain outside the executed scope.

These are not simply testing problems. They are release-confidence problems.

From test execution to continuous release confidence

Blog image week

A connected model makes evidence flow with the engineering work:

Requirement → Change Impact → Verification → Integration → Validation → Assurance → Release Decision

The important difference is continuity.

Traceability, coverage, defects, deviations and test results should not have to be assembled only when a customer review, assessment or release gate approaches. This echoes the continuous-quality principle in Acsia’s preceding QA article: evidence becomes more valuable when it stays visible as the program changes.

It also makes shift-left more meaningful. Virtual environments and automation can move verification earlier and increase execution frequency, while HIL and vehicle-level capacity can focus on the conditions where physical integration adds the most assurance.

How Acsia approaches connected V&V and assurance

Acsia approaches automotive V&V from software through system and vehicle-level testing across digital cockpit, telematics, EV, ADAS and cloud-connected functions. Its capabilities include SIL/MIL/HIL, continuous testing, automated regression and an in-house configurable automation framework, TITAN.

The QA layer adds the other half of the picture: work-product and evidence reviews, traceability, process adherence, non-conformance governance and milestone readiness, within an engineering environment that also spans Automotive SPICE, functional safety and cybersecurity.

The objective is not a longer test list.

It is to connect engineering depth, V&V evidence and quality assurance closely enough that a passing result can support a defensible release decision.

Because for automotive software, “it passed” should be the beginning of the release decision—not the end of it.

If your program is generating substantial test results but still encountering integration surprises, uncertain regression scope, traceability gaps or late release concerns, the issue may not be test execution.

It may be the connection between verification, validation and assurance.

Where is release confidence weakest in your program?

Linked in
Share
Don’t miss an update!
Popular Posts
Building a Robust Cockpit: The Importance of Software Integration and Testing
READ MORE ABOUT
Close-up view of a digital cockpit interface with integrated software modules and diagnostic tools.
Digital cockpit display highlighting the importance of software integration and testing for a seamless in-vehicle experience.
Beyond Features: Why Cybersecurity is Essential for the Modern Cockpit
READ MORE ABOUT
Illustration of a digital car cockpit with a central shield icon, representing advanced cybersecurity measures protecting vehicle systems and data.
Digital cockpit featuring advanced cybersecurity measures for enhanced vehicle safety and data protection.
Your EV is a Smart Companion Unveiling the Power of Connected Car Technology in E-Mobility
READ MORE ABOUT
Electric vehicle driving through a smart city with holographic interface displays highlighting connected car technology and real-time data communication.
Connected electric vehicle navigating a smart city, showcasing advanced telematics and connectivity features."
The Software Revolution Driving E-Mobility: Where Innovation Meets Sustainability
READ MORE ABOUT
Close-up of an electric vehicle being charged, highlighting the innovative software-driven technology powering e-mobility advancements.
Advanced charging technology for electric vehicles, powered by innovative software solutions from Acsia.
The Foundation of the Cockpit: Exploring QNX, Linux, and Android in Automotive
READ MORE ABOUT
High-tech digital cockpit showcasing futuristic interfaces and controls, highlighting the use of QNX, Linux, and Android OS tailored by Acsia for automotive applications.
Advanced digital cockpit powered by QNX, Linux, and Android operating systems, optimised by Acsia for seamless connectivity and user experience.
Request a Meeting
AH2025/PS06 | AI/ML

Context

Continuous employee learning is essential for companies to stay competitive in a fast-changing business environment. Organizations adopt Learning Management Systems (LMS) to upskill employees, meet compliance requirements, and support career growth. However, existing LMS platforms often act as content repositories rather than personalized learning assistants.

 

Pain Point

  • Employees are overwhelmed by generic training content and struggle to find relevant courses.
  • Managers lack visibility into skill gaps and training effectiveness.
  • Companies spend heavily on training programs without clear insights into ROI or business impact.
  • Current LMS solutions provide limited personalization and recommendations, leading to low engagement.

 

Challenge

Develop an AI-powered LMS that goes beyond course hosting, by:

  • Mapping employee skills, roles, and career paths to relevant training modules.
  • Using learning analytics to predict skill gaps and recommend personalized learning journeys.
  • Providing managers with team-level insights on training progress and skill readiness.
  • Enabling employees to learn flexibly, with adaptive learning paths based on performance.

 

Goal

Create a smart, data-driven LMS that improves employee engagement, learning outcomes, and workforce readiness while giving leadership clear visibility into training impact.

 

Outputs

  • Personalized learning recommendations for each employee.
  • Skill gap dashboards for managers and HR.
  • Learning progress analytics with completion, performance, and adoption rates.
  • Training ROI insights linked to productivity and career growth.

 

Impact

  • Employees gain relevant, career-aligned skills faster.
  • Managers can strategically deploy talent based on verified skills.
  • Organizations see higher training ROI and improved workforce agility.
  • Creates a culture of continuous learning, driving retention and innovation.
AH2025/PS05 | AI/ML

Context

Continuous employee learning is essential for companies to stay competitive in a fast-changing business environment. Organizations adopt Learning Management Systems (LMS) to upskill employees, meet compliance requirements, and support career growth. However, existing LMS platforms often act as content repositories rather than personalized learning assistants.

Pain Point

  • Employees are overwhelmed by generic training content and struggle to find relevant courses.
  • Managers lack visibility into skill gaps and training effectiveness.
  • Companies spend heavily on training programs without clear insights into ROI or business impact.
  • Current LMS solutions provide limited personalization and recommendations, leading to low engagement.

Challenge

Develop an AI-powered LMS that goes beyond course hosting, by:

  • Mapping employee skills, roles, and career paths to relevant training modules.
  • Using learning analytics to predict skill gaps and recommend personalized learning journeys.
  • Providing managers with team-level insights on training progress and skill readiness.
  • Enabling employees to learn flexibly, with adaptive learning paths based on performance.

Goal

Create a smart, data-driven LMS that improves employee engagement, learning outcomes, and workforce readiness while giving leadership clear visibility into training impact.

Outputs

  • Personalized learning recommendations for each employee.
  • Skill gap dashboards for managers and HR.
  • Learning progress analytics with completion, performance, and adoption rates.
  • Training ROI insights linked to productivity and career growth.

Impact

  • Employees gain relevant, career-aligned skills faster.
  • Managers can strategically deploy talent based on verified skills.
  • Organizations see higher training ROI and improved workforce agility.
  • Creates a culture of continuous learning, driving retention and innovation.
AH2025/PS04 | AI/ML

Context

Software teams struggle to diagnose system failures from massive log files. Manual analysis is slow, error-prone, and requires expert knowledge. Root cause extraction from unstructured, noisy logs. Use creative algorithms, LLM prompting strategies, or hybrid heuristics.

Pain Point

  • Manual log analysis is slow, error-prone, and requires deep expertise in both the system and its environment.
  • Critical issues can be missed or misdiagnosed, leading to longer downtimes and higher costs.
  • Existing monitoring tools often raise alerts without actionable insights, leaving developers to do the heavy lifting.

Challenge

Build an AI-powered log analytics assistant that can:

  • Ingest and parse unstructured application logs at scale.
  • Automatically flag potential defects or anomalies.
  • Summarize possible root causes in natural language.
  • Provide actionable insights that developers can use immediately.

Goal

Deliver a working prototype that:

  • Operates on sample log data.
  • Produces insights that are accurate, usable, and easy to interpret.
  • Bridges the gap between raw log data and developer-friendly diagnostics.

Outputs

  • Automated defect detection (flagging anomalies in logs).
  • Root cause summaries in natural language.
  • Actionable recommendations (e.g., suspected component failure, probable misconfiguration).
  • Visualization/dashboard (if possible) for quick triage.

Impact

  • Reduced time to diagnose failures, lowering downtime and maintenance costs.
  • Increased developer productivity, freeing engineers to focus on fixes rather than sifting logs.
  • Improved reliability of complex software systems.
  • Scalable approach that can be extended across industries (finance, automotive, telecom, healthcare).
AH2025/PS03 | AI/ML

Context

Drivers and passengers spend significant time in vehicles where comfort, safety, and accessibility directly affect satisfaction and well-being. Yet today’s in-car systems remain largely static and manual, requiring users to adjust climate, seats, infotainment, and navigation themselves. With increasing connectivity, AI offers the potential to transform cars into adaptive, intelligent companions.

Pain Point

  • Current in-car experiences are one-size-fits-all, failing to account for individual preferences or needs.
  • Manual adjustments while driving can be distracting and unsafe.
  • Accessibility gaps (e.g., for elderly passengers or those with hearing/visual impairments) remain unaddressed.

Challenge

Build a Generative AI-powered cockpit agent that dynamically personalizes the in-car experience based on contextual data such as:

  • Driver profile (age, preferences, past behaviour).
  • Calendar & journey type (work commute, leisure trip, urgent travel).
  • Mood (estimated from inputs like speech, facial cues, or self-reporting).
  • Accessibility needs (visual/hearing impairments, elderly passengers).

Goal

Deliver real-time, adaptive personalization of:

  • Comfort settings: AC, seat adjustments, lighting.
  • Infotainment: music, podcasts, news.
  • Navigation guidance: route optimization based on urgency, preferences, and accessibility.

Outputs

  • Dynamic in-car assistant that responds to context in real-time.
  • Personalized environment settings for comfort and safety.
  • Adaptive infotainment & navigation suggestions tailored to mood, journey type, and accessibility.

Impact

  • Safer driving experience with fewer distractions.
  • Higher passenger satisfaction through comfort and entertainment personalization.
  • Improved accessibility and inclusivity for diverse user needs.
  • New value proposition for automakers: cars as intelligent, personalized environments, not just vehicles.
AH2025/PS02 | AI/ML

Context

Automotive software development is highly complex, involving multiple tools (Jira, GitHub, MS Teams, Confluence), distributed teams, and strict compliance standards (ISO 26262, ASPICE). Project managers must continuously monitor tasks, track resources, and identify risks. However, the sheer volume of data across tools makes real-time visibility and decision-making difficult.

Pain Point

  • Project managers waste time manually consolidating data from Jira, GitHub, and communication platforms.
  • Resource allocation bottlenecks (overloaded developers, idle testers) often go unnoticed.
  • Risks (delays, defects, dependency issues) are only discovered late, impacting delivery timelines.
  • Lack of predictive insights leads to reactive, rather than proactive, project management.

Challenge

Build an AI-powered project management assistant that can:

  • Auto-generate project dashboards by integrating Jira, GitHub, and MS Teams data.
  • Provide real-time resource allocation insights (who is overloaded, who is free).
  • Predict risks and delays using historical patterns and live progress signals.
  • Deliver natural language summaries for managers and stakeholders.

Goal

Enable project managers to see the full picture instantly, automate reporting, and take data-driven decisions on resources and risks without manual effort.

Outputs

  • Automated project dashboards (progress, backlog, velocity, open PRs/issues).
  • Resource allocation map showing workload distribution across the team.
  • Risk prediction engine (e.g., “Module X likely delayed by 2 weeks due to dependency on Y”).
  • AI-generated summaries (daily/weekly status reports in plain language).

Impact

  • Reduced management overhead → fewer hours wasted on reporting.
  • Improved predictability → early identification of risks and delays.
  • Optimal resource utilization → balanced workloads across teams.
  • Better stakeholder communication → clear, automated updates.
  • Scalable for enterprises → can be deployed across multiple automotive software teams.
AH2025/PS01 | AI/ML

Context

In modern organizations, assembling the right project team is critical to success. Managers must balance skills, experience, cost, availability, and domain expertise, but decisions are often made using intuition or partial information. This leads to suboptimal teams, missed deadlines, or budget overruns.

Pain Point

  • Team formation today is time-consuming and heavily manual, requiring managers to cross-check spreadsheets, HR databases, and project needs.
  • Costs and expertise trade-offs are rarely quantified, making it hard to justify team composition to leadership or clients.
  • Traditional staffing tools focus on availability but fail to optimize across multi-dimensional constraints (skills, budget, past project fit, timeline).

Challenge

Build a Generative AI assistant that takes as input:

  • Employee database (skills, past projects, availability, cost)
  • Customer project requirements (tech stack, timeline, budget, domain)

Goal

Enable managers to form the best-fit, economically feasible project teams in minutes, rather than days, while providing transparency into why each recommendation was made.

Outputs

  • Optimal team composition: Recommended employees, with justification.
  • Economic feasibility analysis: Skill coverage vs cost vs timeline.
  • Alternative team recommendations: Trade-off scenarios (e.g., lower cost, faster delivery, more experienced).

Impact

  • Faster project staffing → quicker project kick-offs.
  • Higher client satisfaction due to right skills on the right project.
  • Lower staffing costs through data-driven optimization.
  • A scalable framework that can be extended for hackathons, consulting firms, or large enterprise project staffing.