Back to the topic

The mark scheme starts on a new page, so you can print pages one and two for a student and keep the last page yourself. Everything prints in black on white whichever theme you are using.

Key Stage 3 · Y9.5

Artificial Intelligence and the Impact of Computing

Section A: 10 multiple choice questions, 10 marks. Section B: 5 written questions, 22 marks. Total 32 marks.

Name

Class

Date

Mark  / 32

Section A

Circle the letter of the correct answer. One mark each.

  1. 1What is machine learning?1
    1. AA type of computer hardware
    2. BA computer that thinks like a human
    3. CA system finding patterns in large amounts of example data rather than following written rules
    4. DSoftware that writes itself with no data
  2. 2Why might a facial recognition system work less accurately on some groups?1
    1. AThose faces are harder to photograph
    2. BThe algorithm was written to discriminate
    3. CThe camera cannot detect certain colours
    4. DThe training data contained far fewer examples of those faces
  3. 3What is training data?1
    1. AThe labelled examples a system learns patterns from
    2. BThe code that runs the AI
    3. CThe hardware the AI runs on
    4. DThe results the AI produces
  4. 4Why should an AI generated answer be checked against another source?1
    1. AAI systems are always wrong
    2. BIt is produced because it is statistically likely, not because it is true
    3. CAI answers are always too long
    4. DIt is illegal to use AI answers
  5. 5A system that recommends videos is an example of:1
    1. AA human choosing videos for you
    2. BMachine learning finding patterns in what you have watched
    3. CA rule written by a programmer for each user
    4. DRandom selection
  6. 6Which is a genuine problem with automation and employment?1
    1. AMachines cannot do any human job
    2. BAutomation always creates more jobs than it removes in the same town
    3. CThere will be no jobs left at all
    4. DThe jobs created often need different skills and are in different places from those lost
  7. 7Which is a positive environmental impact of computing?1
    1. AMining rare earth metals
    2. BE-waste being exported
    3. CVideo calls reducing the need for business flights
    4. DData centres consuming electricity
  8. 8Who is responsible when a self driving car causes a crash?1
    1. AAlways the programmer
    2. BAlways the owner
    3. CNobody, it is an accident
    4. DIt is genuinely unsettled and involves the owner, manufacturer and regulator
  9. 9An AI trained on a hospital's past decisions may reproduce past unfairness because:1
    1. AIt learns the patterns in the data, including any discrimination
    2. BHospitals always make unfair decisions
    3. CAI systems prefer certain groups
    4. DIt was programmed to be unfair
  10. 10Which question is most useful when judging a new technology?1
    1. AIs it expensive
    2. BIs it new
    3. CWho benefits and who bears the cost
    4. DDo most people like it

Section B

Answer in the space provided. The number of marks tells you how many separate points to make.

  1. 1ExplainExplain what is meant by machine learning.3
  2. 2ExplainExplain why an artificial intelligence system might produce biased results.4
  3. 3GiveGive one advantage and one disadvantage of using AI to mark student work.4
  4. 4DiscussDiscuss the impact of increased automation on employment.8
  5. 5ExplainExplain why an AI system that generates written answers should not be relied on as a source of factual information.3

Mark scheme

Section A

1C2D3A4B5B6D7C8D9A10C

Section B

1 Explain what is meant by machine learning. 3

One mark for each of the following, to a maximum of 3.

  • The system is given a large amount of example data
  • It finds patterns in that data rather than following rules written by a programmer
  • It can then apply what it has learned to new data it has not seen before

Model answer. Machine learning is an approach to artificial intelligence in which a system is given a very large amount of example data rather than being given rules by a programmer. The system adjusts its internal values so that it becomes better at producing the correct answer for those examples, effectively finding statistical patterns in the data by itself. Once trained, it can apply those patterns to new data it has never seen before, for example classifying a photograph it was not trained on. Importantly, it has no understanding of what it is looking at, only patterns that correlate with the right answer.

2 Explain why an artificial intelligence system might produce biased results. 4

One mark for each of the following, to a maximum of 4.

  • The system learns from training data
  • If that data is unrepresentative or reflects past unfairness, the system learns that
  • The system reproduces those patterns in its output
  • This happens without anyone intending it, and the output looks objective

Model answer. An AI system does not have rules written for it. Instead it learns patterns from its training data, so whatever is in that data shapes how it behaves. If the training data is unrepresentative, for example a facial recognition system trained mostly on light skinned faces, the system will simply be less accurate on the groups that were underrepresented. If the training data reflects past human decisions that were unfair, such as years of recruitment decisions at a company, the system learns those patterns too and continues to apply them. What makes this particularly dangerous is that nobody has to intend it: the bias arrives through the data rather than through anyone's prejudice, and because the output comes from a computer it can appear objective and mathematical, so it is trusted more than a human decision would be.

3 Give one advantage and one disadvantage of using AI to mark student work. 4

One mark for each of the following, to a maximum of 4.

  • Advantage: marking is much faster
  • Advantage explained, such as students getting feedback sooner or teachers having more time
  • Disadvantage: it may not understand an unusual but correct answer
  • Disadvantage explained, such as unfair marks or students learning to write for the machine

Model answer. An advantage is speed. An AI system can mark thousands of pieces of work in the time it takes a teacher to mark a handful, which means students receive feedback while the work is still fresh in their minds rather than a fortnight later, and it frees a great deal of teacher time for actual teaching. A disadvantage is that the system does not understand the subject, it recognises patterns, so an answer that is correct but phrased in an unusual or original way may be marked down simply because it does not match what the system learned to expect. Over time this risks teaching students to write for the marking system rather than to think clearly, which is the opposite of what education is for.

4 Discuss the impact of increased automation on employment. 8

One mark for each of the following, to a maximum of 8.

  • Automation removes some existing jobs
  • Gives a specific example such as checkout staff or warehouse workers
  • Automation also creates new jobs
  • Gives examples such as maintenance, programming or data roles
  • The new jobs often need different skills from the jobs lost
  • The people who lose out are often not the people who benefit
  • Considers benefits such as lower prices, safer work or higher productivity
  • Reaches a supported conclusion with a suggestion such as retraining or support

Model answer. Increased automation clearly removes some existing jobs. Self service checkouts have reduced the number of cashiers needed in supermarkets, warehouse robots have replaced pickers, and automated systems have taken over much routine work in factories and call centres. At the same time automation creates new roles, including engineers who design and build the systems, technicians who maintain them, programmers who develop the software and analysts who work with the data they produce. The overall number of jobs in an economy has historically not collapsed because of automation. The real difficulty is that the jobs created are not the same jobs, do not need the same skills and are frequently not in the same places. A supermarket cashier made redundant in a small town does not simply become a robotics technician, because that requires qualifications, training and often relocation, and the areas that lose the most routine work are often those with fewest alternative employers. So the costs fall on specific people who did nothing wrong, while the benefits go to shareholders and to consumers generally. Those benefits are genuine: automation lowers prices, increases productivity and removes people from work that is dangerous, repetitive or damaging to health, and few would argue for putting humans back into the most hazardous factory roles. Overall, automation should not be resisted, because the productivity and safety gains are real and the alternative is simply falling behind. However, it cannot be treated as automatically fine either. Governments and employers have a responsibility to fund retraining, to give reasonable notice, and to support the regions most affected, because otherwise the pattern is that society as a whole gains while a specific and largely powerless group pays for it.

5 Explain why an AI system that generates written answers should not be relied on as a source of factual information. 3

One mark for each of the following, to a maximum of 3.

  • It produces text that is statistically likely rather than verified as true
  • It can therefore state incorrect information confidently
  • Answers should be checked against a reliable source

Model answer. A text generating AI produces each part of its answer because it is statistically likely to follow what came before, based on patterns learned from enormous amounts of text. It has no mechanism for checking whether what it is producing is actually true, and it does not know what it does or does not know. As a result it can state completely incorrect information, including invented statistics, references and quotations, in exactly the same fluent and confident tone it uses for correct information, which makes errors very hard to spot. Anything important that comes from such a system therefore has to be checked against a reliable independent source before it is used or repeated.