↑ ↓ selectEnter openEsc close

    The whole guide for printing: vyvoj.solutia.cz/en/guide/print

    Part III Development: keeping the project on track

    Chapter 17: Meetings and oversight: what the vendor should show you

    ~9 min readUpdated Lukáš Mikula (opens in a new window)

    Trust working software, not presentations. Every two weeks, ask for a demo of the running system in your test environment, and from day one, have access to the repository, the task tracker, and the test version. Watch a few numbers: what share of the budget you have spent, what share of the work you have accepted, and how many defects remain open.

    Agree on the meeting rhythm at signing

    The meeting calendar belongs in the contract or in the project plan you sign. An indicative plan for two-week sprints:

    Recommended meeting calendar
    MeetingWhen and how longWhoWhat for
    Short statusdaily or 2–3× a week, 15 minteam, optionally the product ownerobstacles and questions
    Backlog refinementweekly, 1–2 hproduct owner, analyst, key userspreparing requirements for the next sprint
    Sprint planningevery 2 weeks, 1–2 hproduct owner and teamwhat will be done in the sprint
    Demoevery 2 weeks, 1 hproduct owner, users, ITrunning software in your environment
    Project statusweekly, 30–60 minproject managers of both partiesrisks, spending, cooperation
    Steering committeemonthly, more often in a crisis, 1–2 hsponsor and the vendor’s managementbudget, changes, escalation, continue or not

    The frequency and length of the meetings are indicative.

    Holding meetings is not enough on its own. The participants must work with data and make decisions. In the digital building permit system project, the steering committees met, but according to the audit, nobody responded effectively to the warnings from independent technical oversight, and regular status reporting was missing DSŘ audit, technical part, 2025 (more in chapter 20).

    A demo means running software, not a presentation

    The demo runs in your test environment, not on a developer’s laptop or in PowerPoint. The product owner, key users, and IT attend it, not just the project managers. A canceled or “local” demo is a red flag.

    Prepare your own review plan. The 18F guide recommends checking quality indicators at every demo, usually every two weeks, as part of accepting the work 18F, 2024. One page is enough:

    What to ask to see every sprint:

    What to ask to see every month at the steering committee:

    • what percentage of the budget has been spent and what percentage of the MVP has been accepted,
    • an estimated MVP completion date based on the team’s actual velocity, not just the original plan,
    • the risk register and the status of the measures to address the risks,
    • change requests: approved, rejected, pending, and their impact on the price.

    Access from day one, written into the contract

    Without access, you only check what the vendor chooses to show you. Ask for:

    The Czech adaptation of 18F puts it directly: all outputs, from software to graphic designs, belong to the contracting authority and are handed over at the end of every sprint Česko.Digital, 2022. The answer “you don’t have access to the code for security reasons” means that you have no control.

    A few numbers every manager understands

    • Value: how many user stories you have accepted compared with the plan. A chart where the line of finished work rises toward the scope line is called a burn-up chart.
    • Money: X% of the budget spent against Y% of the MVP accepted. If the share of the budget spent exceeds the share of scope accepted by 15–20 percentage points, it is time to intervene. This is an indicative threshold.
    • Quality: open defects by severity and their trend.
    • Forecast: the MVP date calculated from the team’s actual velocity.

    The technical team can also track the five DORA metrics: how often the team deploys, how long it takes for a change to reach production, how often deployments fail, how quickly the team restores service, and what share of deployments are unplanned fixes DORA, metrics. You do not need to understand them in detail; it is enough to ask to see them and watch whether they improve.

    The “90% done” syndrome

    When a vendor reports 90% for several months in a row, it is a red flag, not evidence of progress. The last 10% usually contains integrations, data migration, performance, and security, which is the hardest part. It is like a painter who has finished all the walls, and only the ceiling, the windows, and the cleanup are missing. So measure accepted scope, not percentages estimated by the vendor. An indicative threshold for escalation: 4–6 weeks without a new result that could be deployed (chapter 19).

    Test

    Is it really 90% done?

    Is the vendor reporting that it’s almost done? Check what applies to your project.

    • Without a deployable increment, you do not know what is really finished. After 4–6 weeks, escalate.

    • Integration is among the hardest work. The last 10% is still ahead of you.

    • Migration reveals errors in the data and in the design. The later it happens, the more expensive it gets.

    • Performance and security problems are the hardest to fix right before launch.

    • The budget is being spent faster than finished work is growing. At this pace, the budget will not be enough.

    • A percentage estimate that does not change is a red flag, not evidence of progress.

    Checked 0 of 6

    Evaluation: add up the points of the checked statements

    0–1 point

    It looks realistic

    Done is what you have seen and accepted. Keep checking this at every demo.

    2–3 points

    Ask for a realistic plan

    The last 10% most likely contains the hardest work. Ask for a plan of the remaining work with deadlines based on the team’s actual velocity, and for a demo in your environment.

    4 or more points

    Hit the brakes

    This many signals at once means that “90%” is more of a wish. Consider an independent audit and escalation; chapter 19 describes the procedure.

    Colors in project status reports

    Green

    The project is on track: deadline, budget, and scope are holding, and no serious problem is open.

    Amber

    The goal is achievable, but the project has serious problems that need management’s attention and decisions.

    Red

    In its current form, the project will most likely fail. It will not work without major intervention (scope, budget, deadline, or stopping the project).

    Watermelon report

    The report is green on the outside and red on the inside. Nobody wants to be the one who brings bad news, so the status light stays green until the last moment. What helps against this is numbers instead of colors, and a management team that says thank you for bad news.

    More in chapter 25: The human factor

    How it goes wrongHow to do it right
    How it goes wrongA PowerPoint report with a green status light and no data.How to do it rightA demo of running software and numbers: budget spending relative to accepted scope, defects by severity.
    How it goes wrongThe demo is on a developer’s laptop, or it gets canceled.How to do it rightA demo in your test environment every 2 weeks.
    How it goes wrongYou have no access to the code “for security reasons.”How to do it rightA repository administered by your organization from day one, with access written into the contract.
    How it goes wrong“We’re at 90%” for the third month in a row.How to do it rightA chart of accepted user stories and a forecast based on actual velocity.
    How it goes wrongThe steering committee is convened only when things are on fire.How to do it rightA monthly steering committee with a fixed agenda: budget, changes, risks, continuation.
    How it goes wrongOnly the project managers attend demos.How to do it rightThe product owner, key users, and IT attend demos.

    Questions

    Questions for the vendor

    1. When will we get access to the repository, the task tracker, and the test environment?
    2. How often do you deploy, and how long does it take for a change to reach the test environment?
    3. What does your weekly report look like, and what numbers will it contain?
    4. What exactly will we see at the demo at the end of the sprint, and in which environment?
    5. How do you calculate the MVP completion forecast: according to the plan, or according to the team’s actual velocity?
    6. How will we find out about a risk before it turns into a delay?

    Solutia video