平成29年度春期 ITパスポート試験問77

This question's explanation and your answers so far.

問77

頻出度★★★

ベンチマークテストに関する記述として, 適切なものはどれか。

出典　平成29年度春期 ITパスポート試験問77

解説

問 77

Incorrectア
Regardless of the internal processing structure, focusing only on inputs and outputs and testing whether the specified output is obtained is the description of a 'black-box test'. Its purpose differs from a benchmark test, which measures performance.
Incorrectイ
Focusing on the internal processing structure and confirming behavior with test cases that cover branch conditions and loop conditions is the description of a 'white-box test', not a benchmark test that evaluates performance.
Incorrectウ
Modeling the behavior mathematically before design and simulating it with a pseudo-program to predict performance is the description of a 'simulation'. Unlike a benchmark test that takes actual measurements on a real machine, it only goes as far as prediction.
エ
正解 A benchmark test is a method in which standard processing (a reference program or workload) is run on an actual computer, actual measured information such as the time taken for the processing is collected, and the system's performance is objectively evaluated and compared. Choice エ states exactly that 'standard processing is set up and actually run, and information such as time is obtained to evaluate performance', which is precisely the definition of a benchmark test, so it is correct.

ここがポイント

Benchmark test = a method that runs standard processing (a reference workload) on a real machine and takes actual measurements such as processing time to evaluate and compare performance.
Distinguishing similar concepts: black-box test (whether input/output meets the specification), white-box test (coverage of the internal structure), and simulation (performance prediction using a model) all have different purposes.

用語

解答問77エ