Understanding Large Language Model-Generated Translations:
How Can They Adapt to Different Translation Specifications and Pass the Translation Turing Test?

Monday, 23 June (9 am – 12.30 pm)

9:00 Session 1: The Translation Turing Test (45 mins) 

• Language industry practice and rational of the TTT (including the original Turing Test)
• Importance of Project Management
  • Translation standards ASTM F2575, ISO 116900 (2mins)
• MQM Intro-TQE
• The Translation Turing test
• 3 parts of the TTT:
  • ST negotiation client with PM (specification)
  • TT evaluation (TT quality assessment)
  • TT negotiation client with PM (complaint)
• Experimental setup

9:45 Session 2: Requester-Provider Negotiations (45 mins) 

• Project Managers (PMs) present themselves (10 mins)
• Round 1: ST negotiation (30 mins)
  • Paper trail review:
    • PM1
    • PM2
    • PM3
• Partial TTT (5 mins)

10:30 Break 30 mins

11:00 Session 3 Translation Quality Evaluation (45 mins) 

• General introduction to quality evaluation and how it relates to the TTT (5 mins)
• Evaluation of French translations (20 mins)
• TPR-DB+Syntactic Complexity (15 mins)
• Formulating translation complaints (5 mins)

11:45 Session 4 TT negotiation  

• Round 2: TT negotiation (25 mins)
  
  • Paper trail review (PM index numbers don’t correspond to round 1 negotiations):
    
    • PM1:
      
      • Translation
      • Renegotiation
      • Retranslation
    • PM2
      
      • Translation
      • Renegotiation
      • Retranslation
    • PM3
      
      • Translation
      • Renegotiation
      • Retranslation

• Expert evaluation (10 mins)
• Final discussion (10 mins)

12:30 End