Facial Recognition Technology Challenges And Limitations

IAS Current Affairs

1 hour ago

Makeup Against Facial Recognition Technology

Source: Indian Express
GS III: Artificial Intelligence, Facial Recognition Technology and Cybersecurity

Overview

Facial recognition technology uses AI to identify or verify individuals by analysing facial features, with applications in security, law enforcement and digital authentication.
Specially designed makeup patterns may interfere with certain facial recognition systems, but their effectiveness varies across models and operating conditions.
The use of facial recognition raises concerns about privacy, misidentification, algorithmic bias and surveillance, highlighting the need for safeguards under India’s legal and constitutional framework.
A balanced approach involving clear regulations, independent oversight, accuracy testing and data protection is essential to ensure responsible use of facial recognition while safeguarding the right to privacy.

Why in the News?

A recent makeup tutorial on X has highlighted whether cosmetics can interfere with facial recognition systems used for surveillance.

News in Brief

Facial recognition technology (FRT) uses artificial intelligence (AI) to analyse facial features and compare them with stored facial representations to identify individuals.
Makeup can alter the facial features captured by a camera and interfere with the identification process, but it does not necessarily prevent a system from detecting a face.
Research by Ben-Gurion University of the Negev demonstrated that specially designed, computer-generated makeup patterns could interfere with certain facial recognition systems.
In India, facial images and digital templates linked to identifiable individuals fall within the broad definition of personal data under the Digital Personal Data Protection Act, 2023, subject to the Act’s provisions and exemptions.

What is Facial Recognition Technology?

Facial recognition is a biometric identification technology that uses facial characteristics to verify or identify a person.
How it works;
- Face detection: The system identifies the presence and location of a face in an image or video.
- Feature extraction: AI models analyse facial characteristics and convert them into a numerical representation called a face embedding.
- Database comparison: The representation is compared with stored facial representations to find a potential match.
- Identification: The system determines whether the face corresponds to an individual in its database, depending on the matching threshold.
Facial recognition systems learn patterns associated with identities from training data.
They do not simply compare photographs pixel by pixel.

How can makeup interfere with facial recognition?

Makeup can alter the appearance of facial features captured by a camera.
Patterns around the eyes, lips and eyebrows may affect the numerical representation generated by some recognition models.
This may reduce the likelihood of a successful match without necessarily preventing the system from detecting a face.
The effectiveness of such techniques varies across systems and operating conditions.
Therefore, interfering with facial identification is not the same as preventing facial deection.

Research on Makeup and Facial Recognition

Ben-Gurion University of the Negev Study (2021)

Researchers demonstrated that specially designed, computer-generated makeup patterns could consistently interfere with certain state-of-art facial recognition systems.
The patterns were designed with the help of machine learning to interfere with specific recognition models.
The study demonstrated that carefully designed makeup could reduce identification accuracy under the tested conditions.
It did not establish that all unusual makeup, additional facial features or coloured patterns could reliably defeat surveillance systems.
The findings highlight potential weakness in facial recognition technology and the need to evaluate its reliability under different conditions.

CV Dazzle Project

CV Dazzle was an artistic project that explored how unconventional makeup and hairstyles could interfere with computer vision algorithms.
It drew inspiration from the Dazzle camouflage used during the First World War.
Naval ships were painted with high-contrast colours, stripes and geometric patterns to make it harder for enemy observers to estimate their position, direction and movement.
Similarly, CV Dazzle explored how changes in facial appearance could interfere with machine-based facial analysis.
Both approaches demonstrate how visual patterns can challenge automated recognition.
However, the makeup techniques discussed in these projects may also make a person more conspicuous to human observers.

Limitations of makeup-based techniques

Facial recognition systems differ in their algorithms and identification thresholds.
Camera resolution, lighting and viewing angles influence performance.
A technique that interferes with one model may not work against another.
Methods designed to disrupt identification may not prevent face detection or other forms of surveillance.
Thus, makeup should not be considered a reliable or universal method of defeating facial recognition.

Facial Recognition and Artificial Intelligence

Facial recognition is a form of biometric technology that uses distinctive physical characteristics to identify or verify individuals.

Applications

Law enforcement and criminal investigations.
Airport security and border management.
Digital identity verification and authentication.
Access control in workplaces and restricted facilities.
Finding missing persons and identifying unknown individuals.

Advantages

Enables rapid identity verification.
Can assist investigations and security operations.
Reduces dependence on manual identification in certain settings.

Concerns and Challenges

Privacy violations and surveillance without meaningful consent.
Misidentification and false matches.
Potential bias arising from training data and system design.
Lack of transparency and accountability in some deployments.
Risks of misuse and excessive surveillance.

Facial Recognition and Privacy in India

Digital Personal Data Protection Act, 2023

The Act provides a legal framework for processing digital personal data in India.

Facial images and digital templates linked to identifiable individuals can qualify as personal data.
The Act establishes obligations concerning the processing of personal data, subject to its scope and applicable provisions.
Section 17 provides exemptions for specified circumstances, including certain processing connected with preventing, detecting, investigating or prosecuting offences.
The Central Government can also exempt specified state instrumentalities from certain provisions on grounds such as national security and public order, subject to the statutory conditions.
Important Limitation
- The Act does not establish a comprehensive, dedicated legal framework specifically governing police use of facial recognition technology.
- Consequently, questions remain about the legal basis for deployment, safeguards against misuse, accountability and protection of individual privacy.

Constitutional Perspective: Right to Privacy

In the Justice K.S. Puttaswamy v. Union of India judgment of 2017, the Supreme Court recognised the right to privacy as a fundamental right under the Constitution.
The judgment is relevant to facial recognition because large-scale biometric surveillance can affect personal autonomy, dignity and individual liberty.
State use of facial recognition must therefore be examined in the context of constitutional protections, applicable laws and safeguards against arbitrary interference with privacy.

Way Forward and Conclusion

India needs a clear legal framework for facial recognition that defines the conditions for its use, particularly by law enforcement agencies. Mandatory accuracy testing, independent audits, transparency in data collection and retention, and safeguards against algorithmic bias are essential to prevent misuse. Surveillance should meet the principles of necessity and proportionality, with effective grievance redressal mechanisms.

Facial recognition can strengthen security and improve public services, but its use must respect individual privacy and constitutional rights. A balanced approach combining technological innovation, data protection and accountability is essential to ensure that security does not come at the cost of civil liberties.

UPSC Prelims and Mains Practice Question

Consider the following statements about facial recognition technology:

1. Facial recognition systems can convert facial characteristics into numerical representations for comparison.
2. Makeup that interferes with facial identification necessarily prevents a system from detecting a face.
3. The Supreme Court recognised the right to privacy as a fundamental right in the Justice K.S. Puttaswamy judgment.
4. The Digital Personal Data Protection Act, 2023, establishes a comprehensive legal framework exclusively for police use of facial recognition technology.

Which of the statements given above are correct?
(a) 1 and 2 only
(b) 1 and 3 only
(c) 2 and 4 only
(d) 1, 3 and 4 only

Answer: (b) 1 and 3 only

Mains Practice Question

Q) Discuss the challenges posed by emerging technologies to the right to privacy in India. Suggest suitable measures to ensure a balance between technological advancement and individual rights. (250 words)

Daily Current Affairs: Click Here