Extractors were also asked to estimate how much extra time was required for extraction compared to a similar English language article. Data extracted included: eligibility criteria, treatment description, study descriptors, quality issues, outcome description, and results. These five researchers also double data extracted 10 English language RCTs. The English translated versions of the articles were extracted by one of five current EPC researchers who did not speak the given language.

Data from the original language versions of the articles were extracted by one of 10 fluent speakers who were current or former members of our EPC. The time required to translate each study was tracked. Each article was translated into English using Google Translate. Eligible studies were RCTs that reported per-treatment group results data (except for Hebrew language studies, where no RCTs were identified). We retrieved 10 randomized controlled trials (RCTs) in eight languages (Chinese, French, German, Italian, Japanese, Korean, Portuguese, and Spanish) and eight observational studies in Hebrew. Therefore, we formally evaluated the accuracy of Google Translate for the purpose of data extraction of non-English language articles. However, it is unknown whether its translation accuracy is sufficient for Evidence-based Practice Center (EPC) systematic reviews. Google Translate, a free Web-based resource for translation, has recently become available. However, study eligibility is often restricted to English language for practical reasons.

Systematic review prides itself on inclusion of all relevant evidence.

Google translate to korean to english