outcome definitions, and to ensure that the central research team has understood the data correctly. The time and resource needed for checking will depend on how clean the data are on arrival and the extent of checking required. Allowing about three or four days per trial for carrying out data checking is a good starting point. It is useful to allow extra time beyond when the last dataset might be received, in order to complete the checking processes.
Sufficient time must also be factored into timelines for the meta‐analyses, and it is important that this critical phase does not get squeezed if data collection takes longer than anticipated. There is sometimes a misconception that statistical analyses are straightforward and can be done at the click of a button, but this is never the case. Assuming data are cleaned and ready for analysis, usually at least six months will be required for the statistical phase of an IPD meta‐analysis of randomised trials to evaluate treatment effects. Often, multiple analyses will be needed, for example to analyse multiple outcomes, subgroups, and participant‐level covariates, as well as sensitivity analyses and production of associated summary tables and graphs. If complex modelling is planned, such as using multiple imputation to deal with missing data (Chapter 18), analysing non‐linear relationships (e.g. for treatment‐covariate interactions; Chapter 7) or network meta‐analysis (Chapter 14), then six to 12 months will be a more sensible time frame. Furthermore, although most problems with data should be identified when checking data, issues may still arise during synthesis that require further communication with the trial investigators.
Generally, IPD meta‐analysis projects will take upwards of two years to complete, and sometimes longer depending on how many trials are involved and the complexities of negotiating collaboration, data coding, checking, cleaning and analysis. Delays may be outside the control of the project team. Flexibility in staffing and scheduling is needed to accommodate this, which can make setting and meeting funder milestones challenging. In our experience, extensions to the original timelines agreed with funders may be required, particularly if key trials delay sending their IPD. Work may be most intense at the beginning and end of a project, and this can be borne in mind when planning resourcing and staffing. Nonetheless, it is important that projects are actively managed at all times and that the research team keep on top of projects and moving them forward.
Prospective IPD meta‐analysis projects will additionally need to run to timelines that accommodate those of the participating trials (Section 3.12).
3.8 Estimating the Resources Required
IPD meta‐analysis projects cannot be done by a small volunteer review team and usually cost more than a standard systematic review. However, they are considerably less expensive than carrying out a new clinical trial, which may be the only reliable alternative to addressing the research question that the IPD meta‐analysis aims to resolve.
Box 3.3 lists the main costs involved in an IPD meta‐analysis project, and may be useful starting point in preparing a budget and seeking funding. Most items should be self‐explanatory. Some costs are similar to conventional systematic reviews such as those involved in acquiring publications (e.g. inter‐library loan charges) and some aspects of dissemination activity such as open access publishing fees. Additional costs are more specific to individual projects, and largely correlate with the number of trials, complexity of the IPD obtained, and type and number of analyses required, as these are major drivers the staff effort needed.
Funding staff time is likely to be the largest project cost. Whilst the staff resource needed for some tasks will be similar to a conventional systematic review, such as those associated with searching and screening studies for inclusion, other costs will be highly dependent on the size and scope of the project. As described in Section 3.7, sufficient staff time needs to be allowed for checking and recoding variables within IPD and for performing the analyses.
In addition to the time taken to manage and oversee a major research project, the time needed for managing the wider collaborative process, for negotiating data provision, and for communication and collaboration must also be budgeted for, but is easily overlooked. For example, an IPD meta‐analysis project that included IPD from 31 trials involved sending and receiving over 5,000 separate emails.79 Given that even the simplest of these probably takes a few minutes to handle, it is not difficult to see how the resource spent on this type of activity mounts up. As managing the collaboration has potential to be sensitive and political, a significant amount of principal investigator time may be needed for communication.
Box 3.3 Typical costs incurred in an IPD meta‐analysis project
Staff Costs
Principal investigator (considerable time may be needed for this strategic and diplomatic role)
Clinical/topic expert members of team (resource depends on level of involvement)
Experienced statistician (to plan supervise and undertake complex syntheses)
Statistician(s) (to plan, code and carry out analyses)
Researcher(s) (to screen, assess risk of bias, re‐code, check data)
Information specialist (likely to be similar to a standard systematic review)
Administrative support (e.g. to organise results meeting)
IT support (if there are special requirements or if not provided by host institution)
Legal input to data‐sharing agreements (if not provided by host institution)
General Costs
Inter‐library loans and document acquisition (similar to a standard systematic review)
Telephone and teleconference calls with trial investigators
Conference calls for advisory or collaborative group meetings
Any travel likely to be needed to secure provision of data
Any specialist software required for data management or statistical analysis
Fees
Data preparation bursaries or fees to trial investigators for preparing data (if these are used)
Any fees to data‐sharing repositories for access to data
Any special licenses required to read/handle repository data
Advisory Group Meetings
Travel and venue costs (can be reduced by holding most meetings virtually)
Catering for face‐to‐face meetings
Patient and Public Involvement Costs
Payment for contributed time, including preparing for and attending meetings
Travel to meetings and incidental expenses
Collaborative Group Meeting
Venue and equipment hire
Catering during meeting
Other