Skip to content

Performance Evaluation

頻出~16 min3 terms7 past questions

Goals of this unit

  • Explain the start and end points of the interval that response time measures.
  • Explain that response time written as 応答時間 is just another name for the same interval as レスポンスタイム.
  • Explain that a benchmark evaluates performance by running standard workloads on the actual machine.
Terms at a glance (3)
TermIn one lineTypeInterval measured / method
レスポンスタイムThe time from finishing input of a request until the first response starts to come back.Performance metric (time)From end of input to start of response
応答時間The kanji-based Japanese name for response time, referring to the same interval.Performance metric (time)Same interval as response time
ベンチマークA method that actually runs a workload fixed as the standard and evaluates performance from the measured values.Performance evaluation methodRuns standard workloads on real machines and measures them

Terms

レスポンスタイムResponse time

Open in glossary レスポンスタイム

Response time レスポンスタイム is the time from when a user finishes entering a processing request until the system's first response begins to come back.

  1. Finish entering request
  2. Transmission and processing
  3. First response starts

Timing stops when the first response starts to arrive, and this span is the response time.

3 / 3

Timing starts when input ends, so the time spent on the input itself is not included. Shorter values mean less waiting for the user, which matters most in online processing オンライン処理, where people work interactively with the screen.

AnalogyIt is like the gap between finishing your request at a service counter and the clerk's first words in reply. That is counted separately from the time needed to finish the whole procedure.

Exam points

  • ExamThroughput スループット is the amount of work finished within a given time, while response time レスポンスタイム is how long a single request takes to get a response.
  • Mix-upTurnaround time ターンアラウンドタイム runs from submitting a request until all results have been output, a longer span than response time, which stops when the response begins.

1 past questions on this term レスポンスタイム

応答時間Response time (Japanese term)

Open in glossary 応答時間

Response time written as 応答時間 is the kanji-based Japanese name for response time and refers to exactly the same interval.

Documents differ only in whether they use the katakana word or the kanji word, and neither the interval measured nor which way counts as better (shorter is better) changes. Whichever name appears, read it as the same metric.

How to rememberIn 応答時間, 応答 is the word used to render the English "response," so it means the same as the katakana レスポンス.

Exam points

  • ExamResponse time 応答時間 covers the span from the moment the user finishes input to the moment the system's response starts to come back.

1 past questions on this term 応答時間

ベンチマークBenchmark

Open in glossary ベンチマーク

A benchmark ベンチマーク is a method that actually runs a workload fixed as the standard on the system being evaluated and uses measured values such as processing time to evaluate and compare performance.

  1. Fix the standard workload
  2. Run on real machines under the same conditions
  3. Compare measured values

Line up the measurements, such as time taken, and evaluate performance.

3 / 3

Because every system is measured with the same workload under the same conditions, results can be compared fairly even across different models and configurations. The workload is chosen to match what the system will be used for. It is also called a benchmark test (ベンチマークテスト).

AnalogyIt is like a test where everyone solves the same questions within the same time limit and ability is compared by score.

How to rememberThe word originally meant a mark cut by surveyors as a reference for height, and the sense of "a reference for comparison" carried over to performance evaluation.

Exam points

  • ExamThe values a benchmark ベンチマーク produces are actual measurements taken by really running the standard workload on the machine being evaluated.
  • ExamSPEC is a neutral organization that develops benchmarks for comparing performance and publishes the results.

1 past questions on this term ベンチマーク

Response time vs. Benchmark

AspectResponse timeBenchmark
Key differenceWhat it isA performance metric (a length of time)A method for examining performance
What you getThe wait for a single requestA set of values measured by running standard workloads
Main useChecking how fast interactive processing isComparing systems of different models or configurations under the same conditions

Key points

  • Response time runs from the end of input until the first response begins to return, and shorter means better performance.
  • The kanji term 応答時間 refers to the same interval as response time, and only the name differs.
  • A benchmark runs standard workloads on the real machine and evaluates performance from the measured values.
  • SPEC is an organization that develops benchmarks and publishes their results from a neutral position.

Check questions

4 past questions from this unit

Start the check questions

All past questions in this topic