India's Supreme Court has taken a firm stance against the misuse of AI in judicial proceedings, threatening legal consequences after a junior judge was found to have issued fake AI-generated orders in a property dispute case. The court's response to the defendants' appeal has sparked a critical examination of the integrity of the adjudicatory process and the potential risks associated with AI-generated content. This incident highlights a growing concern in the legal system, as it follows a series of similar cases where AI has disrupted court proceedings worldwide.
The issue arose in August when a junior civil judge in Vijaywada city, Andhra Pradesh, passed an order in a property dispute case, citing four past legal judgements that were later discovered to be AI-generated. The defendants challenged the order, pointing out the fake citations, and the state's high court acknowledged the error, attributing it to the judge's 'good faith' use of AI. However, the high court's decision to uphold the trial court's ruling despite the fake citations has raised questions about the reliability of AI-generated content in legal contexts.
The high court's stance emphasizes the need for human oversight and the importance of maintaining institutional safeguards. It advocates for the use of 'actual intelligence' over artificial intelligence, highlighting the potential for AI to 'hallucinate' and generate false information. The junior judge, who admitted to using an AI tool for the first time, expressed her belief in the citations' authenticity, but the high court's response underscores the necessity of human review and critical evaluation of AI-generated content.
This case has prompted the Supreme Court to take a stern approach, deeming the use of AI in making judgements as 'misconduct' rather than a mere error in decision-making. The court has stayed the lower court's order and issued notices to the country's Attorney and Solicitor General, as well as the Bar Council of India, indicating a thorough examination of the case. The Supreme Court's concerns extend beyond this incident, as it has previously raised issues with lawyers using AI tools to draft petitions, emphasizing the need for regulation and monitoring of AI in the courtroom.
India's legal institutions are not alone in grappling with the challenges of AI in courts. The US and the UK have also faced similar issues, with federal judges and the High Court of England and Wales calling out the use of AI tools for errors and fictitious rulings. The global legal community is increasingly recognizing the need for guidelines and best practices to ensure the responsible and ethical use of AI in the judicial process, balancing the benefits of AI with the critical need for human oversight and integrity.
