Translate

Showing posts with label UNCRPD. Show all posts
Showing posts with label UNCRPD. Show all posts

Saturday, 27 June 2026

The Revolution That Left Us Out: Disability, AI, and the Incomplete Conversation About Humanity

 

The illustration captures a stark contrast between two worlds. On one side, high-tech, gleaming skyscrapers labeled "Tech City," "Financial District," and "Global Revolution Hub" represent a futuristic, exclusionary progress accessible only to "the chosen few, tech gurus, and elites." On the other side of a high, formidable wall, ordinary citizens—including a street vendor, laborers, and families—are left navigating a crumbling, neglected path. A security guard labeled "System" blocks access to the gated hub, reinforcing the barrier between the promised technological revolution and those still waiting for basic services and fundamental needs. The scene is depicted from the perspective of the common citizen standing outside, looking in at the inaccessible development.
While the 'Revolution' digitizes the horizon for the elite, the rest of us are still waiting for the pavement under our feet to be fixed.

A recent article in The Hindu, titled "Keeping Humanity at the Centre of the AI Revolution," [Click here for link to the article] raises questions that matter. It asks whether the rapid advance of artificial intelligence systems is moving faster than our collective ability to govern them. It is concerned with the risks of automation displacing labour, with the concentration of technological power in a small number of corporate actors, and with the erosion of human agency in decisions that shape livelihoods and social participation. These are serious concerns. They deserve serious examination.

But the article says a great deal about humanity and very little about a substantial part of it.

Disability does not appear in that conversation. Not once. And that absence is not a minor editorial oversight. It is symptomatic of a much older pattern: disability is admitted into the AI ethics discourse only when someone specifically demands its inclusion. It does not arrive on its own. It has to be carried in, repeatedly, by the same people who bear its exclusion.

This article is that demand.

What the Conversation Is Getting Right, and What It Is Missing

The concern with human-centred AI is not new. Researchers, civil society organisations, and several governments have spent years arguing that artificial intelligence must be designed with people in mind rather than profits or efficiency metrics. The Hindu article reflects this concern well. It draws attention to the fact that AI systems, however sophisticated, are built upon choices made by people. Those choices carry values. Those values carry biases. And those biases reproduce the social conditions that shaped them in the first place.

This is an important argument. It is also, in the disability rights community, an argument we have been making for the better part of a decade.

The AI Now Institute's foundational 2019 report, "Disability, Bias, and AI," made exactly this case. It documented how artificial intelligence systems, when trained on data that underrepresents disabled people, produce outputs that treat non-disabled behaviour as the universal standard. The systems are not neutral. They are calibrated to a particular body, a particular mode of speech, a particular speed of response, a particular pattern of interaction. When disabled users fall outside those calibrations, they are not accommodated. They are rejected.

That report was published six years ago. Mainstream AI ethics commentary in India is still not routinely engaging with it.

The Hindu article's conversation about humanity is, in this sense, a conversation about a subset of humanity. It addresses displacement of labour, questions of democratic accountability, the ethics of automation in public services. All of this is important. But when disability is absent from the frame, what emerges is an incomplete picture of who stands to be most harmed, and therefore an incomplete framework for remedy.

Technoableism Is Not a Technical Problem. It Is a Political One.

The word technoableism was put into sustained analytical use by Ashley Shew, a disability studies scholar and engineer at Virginia Tech, whose 2020 work in IEEE Technology and Society Magazine named the ideology that drives much of what passes for progressive AI design. Technoableism is the assumption that disability is a problem requiring technological elimination. It is the belief that the goal of assistive or accessible technology is to make the disabled person function more like a non-disabled person. It frames difference as defect, and positions the non-disabled body as the ideal towards which all technological development ought to strive.

This ideology does not announce itself. It arrives quietly, encoded into design decisions that no one has bothered to question.

Consider how this operates across the AI development pipeline. When training data for voice recognition systems is assembled, the overwhelming majority of voice samples are from speakers without speech disabilities. The system learns what a voice is supposed to sound like. When a person with cerebral palsy, amyotrophic lateral sclerosis, or a stammer interacts with that system, the system fails. Not because the technology is inherently incapable. Because the people who built it did not think to include the full range of human speech in their model of what a human voice sounds like.

This is Selection Bias. It is also a straightforward act of exclusion. It is not accidental. It is the consequence of disabled people being absent from the design room, the data team, the product meeting, and the ethics board.

The same logic applies to hiring systems that flag disabled communication styles as indicators of low confidence or low performance. It applies to facial recognition systems that fail to accurately identify people with atypical facial features or expressions. It applies to content moderation systems that flag disability-related language as offensive without distinguishing between slurs and community self-identification. It applies to large language models that, when asked to generate disability-related content, produce outputs that are clinical, condescending, and rooted in medical deficit models rather than disability rights perspectives.

Research published in 2025 by Panda, Agarwal, and Patel, introducing the AccessEval benchmarking framework, confirmed that disability bias in large language models is systemic rather than incidental. These are not edge cases. They are structural outcomes.

India's AI Moment and the Disability Rights Framework It Is Ignoring

The Hindu article is written in an Indian context, addressing an Indian readership, at a moment when India is making significant policy commitments around artificial intelligence. The India AI Impact Summit, NITI Aayog's AI governance guidelines, and the government's broader rhetoric about an "AI for All" future all claim a vision of inclusive technological development.

That vision does not hold up to scrutiny when examined from a disability rights standpoint.

India has 2.74 crore persons with disabilities according to the 2011 Census. The true figure is considerably higher by most independent estimates, given systemic undercounting. These individuals are spread across urban and rural geographies, across caste and class divisions, and across 21 categories of disability formally recognised under the Rights of Persons with Disabilities Act 2016. They are also among the most dependent upon digital public infrastructure for access to services, entitlements, information, and economic participation.

Yet NITI Aayog's AI governance documents, as I have argued previously on this platform and in an open letter to the Ministry of Electronics and Information Technology, treat disability as a sectoral afterthought rather than a structural dimension of all AI systems. The guidelines speak of inclusion in general terms. They do not mandate disability-inclusive data collection. They do not require accessibility impact assessments for AI systems deployed in public services. They do not integrate the RPwD Act 2016 into their governance framework. They do not reference the Supreme Court's landmark judgment in Rajive Raturi v. Union of India, which in November 2024 established accessibility as an ex-ante constitutional duty rather than a discretionary accommodation.

The Raturi judgment is significant precisely because it forecloses the kind of argument that AI governance currently makes by implication: that accessibility will be addressed eventually, after the core system is built. The Supreme Court held that accessibility is not a post-hoc retrofitting exercise. It is a baseline requirement that must be built into new infrastructure from the start. That principle applies with full force to AI systems, which are new infrastructure. If it applies to ramps and lifts, it applies to hiring algorithms and speech interfaces.

India's position under the United Nations Convention on the Rights of Persons with Disabilities reinforces this obligation. Article 4(1)(d) of the UNCRPD requires state parties to refrain from engaging in any act or practice that is inconsistent with the Convention, and to ensure that public authorities and institutions act in conformity with it. Article 9 requires accessible information and communication technology as a matter of right. These are not aspirational norms. India ratified the UNCRPD in 2007. The obligations are binding.

When The Hindu publishes a substantive opinion piece about keeping humanity at the centre of the AI revolution, and does not engage with these legal frameworks or the constituencies they protect, it participates in the same pattern of omission that characterises the policy it is critiquing. The critique of AI governance cannot exempt itself from the structural blind spots of AI governance.

The Difference Between Accessibility and Inclusion

There is a distinction that this discourse consistently collapses, and it is a distinction that persons with disabilities experience with considerable personal consequence.

Accessibility determines whether a person can use the system. Inclusion determines whether the system was designed with that person as a full human subject, rather than as an edge case to be accommodated later.

Accessible platforms built upon biased algorithms do not remove barriers. They move the barrier from the interface to the algorithm. A screen-reader-compatible job application portal that feeds into a hiring algorithm trained to penalise atypical speech patterns or non-linear employment histories is accessible in a technical sense and exclusionary in a structural one. The disabled applicant can submit the application. The system will still reject them.

The conversation about human-centred AI must therefore go further than user interface accessibility. It must address the assumptions embedded in the data, the objectives embedded in the optimisation function, and the absences embedded in the design team. Universal Design is not a feature to be added on. It is a methodology of designing from the margins outward, such that systems built to work for the most excluded users tend to work better for everyone.

The curb-cut effect, well documented in both physical and digital environments, illustrates this principle. Features designed for wheelchair users, closed captions developed for deaf and hard-of-hearing users, voice interfaces developed for users with motor impairments: these have consistently expanded usability for the broader population. Disability-led design is not charity. It is better engineering. It is a stress test for inclusion that the mainstream AI development pipeline systematically refuses to conduct.

Nothing About Us Without Us Is Not a Slogan. It Is a Design Requirement.

The principle of Nothing About Us Without Us, central to the disability rights movement since the 1980s, is sometimes treated by technologists as a vague aspirational gesture. It is in fact a precise methodological requirement.

It means that disabled people must be present at the data collection stage, so that training datasets capture the full range of human speech, movement, cognition, and behaviour. It means that disabled people must be present at the design stage, so that the objectives of the system are not calibrated exclusively around non-disabled norms of productivity, efficiency, and interaction. It means that disabled people must be present at the evaluation stage, so that bias audits assess performance across the full spectrum of the population rather than optimising for majority user groups and treating minority outcomes as acceptable collateral.

Research from the AAAI Conference on Artificial Intelligence in 2025, examining ableism in both Western and Indic language models, found that Indian AI systems consistently underestimate the harmfulness of ableist statements. The models reflect the cultural tolerances of the dominant society they were trained on. When that society normalises certain forms of disability-related discrimination, the model inherits that normalisation. Building cross-cultural competence into AI evaluation frameworks is therefore not an academic nicety. It is a basic requirement of fairness for the 2.74 crore Indians whose lives will increasingly be shaped by these systems.

This is the argument that the human-centred AI conversation must make room for. Not as a supplement to the main concern. As part of it.

Conclusion: Incomplete Humanity Is Not Humanity

The Hindu article is concerned about AI doing things to people without their meaningful participation. That concern is legitimate and necessary. But it is also incomplete. Because the people most likely to have AI systems act upon them without their participation, without their input into the training data, without representation in the design team, without recourse in the legal framework, without visibility in the policy document, are disabled people.

Disability is not a niche interest within the AI ethics discourse. It is the discipline's most rigorous test case. If an AI system cannot account for the full range of human bodies, minds, speech patterns, and modes of being in the world, it has not achieved human-centred design. It has achieved able-bodied-centred design dressed in the language of inclusion.

India is at a formative moment in shaping its AI ecosystem. The decisions being made now, about data, design, governance, and accountability, will embed their assumptions into public infrastructure for decades. If disability is absent from those decisions, the resulting systems will not be accessible to 2.74 crore Indians by omission. The omission will be structural and, given the legal frameworks now in place, unconstitutional.

The conversation about keeping humanity at the centre of the AI revolution must therefore include all of humanity. Not as a courtesy. As a constitutional obligation, as a matter of rights, and as a basic condition of the claim that the revolution is being made for people.

Those of us who have spent our lives being treated as edge cases, as outliers, as system anomalies, are not interested in watching another revolution proceed without us. We are the stress test. We are also the users. And it is past time that the mainstream AI ethics discourse remembered both.\

References

  • Whittaker, M., Alper, M., Bennett, C.L., et al. (2019). Disability, Bias, and AI. AI Now Institute. https://ainowinstitute.org/disabilitybiasai-2019.pdf
  • Shew, A. (2020). Ableism, Technoableism, and Future AI. IEEE Technology and Society Magazine, 39(1), 40-85.
  • Panda, S., Agarwal, A., and Patel, H.L. (2025). AccessEval: Benchmarking Disability Bias in Large Language Models. Proceedings of EMNLP 2025. ACL Anthology.
  • Phutane, M., Seelam, A., and Vashistha, A. (2025). A Human-Centered Audit of Ableism in Western and Indic Language Models. AAAI Conference on Artificial Intelligence.
  • Rajive Raturi v. Union of India and Others, Writ Petition (Civil) No. 4/2005, Supreme Court of India, Judgment dated 8 November 2024.
  • Rights of Persons with Disabilities Act, 2016. Ministry of Law and Justice, Government of India.
  • United Nations Convention on the Rights of Persons with Disabilities, 2006. Articles 4 and 9.
  • Singit, N. (2025). An Open Letter to the Ministry of Electronics and Information Technology: A Critique of the India AI Governance Guidelines on the Omission of Mandatory Disability and Digital Accessibility Rules. The Bias Pipeline. https://thebiaspipeline.nileshsingit.org
  • Singit, N. (2026). Technoableism and the Bias Pipeline: How Ableist Ideology Becomes Algorithmic Exclusion. The Bias Pipeline. https://thebiaspipeline.nileshsingit.org
  • Singit, N. (2026). TechnoAbleism in India's AI Moment: Why Accessibility Is Not Enough. Moneylife.in / The Bias Pipeline. https://thebiaspipeline.nileshsingit.org

Thursday, 26 February 2026

AI for All or Exclusion by Default? Open Letter to PM Narendra Modi on Disability Bias in Artificial Intelligence, Accessibility Challenges, and Lessons from India AI Impact Summit 2026 – Addressing TechnoAbleism in India's AI Policy and Governance

Date: 26/02/2026

To,

Shri Narendra Modi Ji
Hon’ble Prime Minister of India
South Block, New Delhi

Subject: On Artificial Intelligence, Disability Bias, and the Meaning of “AI for All

Hon’ble Prime Minister,

Namaskar.

I write to you not as a technologist, nor as a lawyer by formal training. I write as a citizen who lives with disability, and as someone who has had to understand both law and technology simply in order to participate in ordinary life. Much of what I know about systems has not been learnt in classrooms. It has been learnt at doorways without ramps, on websites without structure, and in digital forms that could not be completed without assistance.

Exclusion rarely announces itself. It is usually designed quietly.

At the India AI Impact Summit 2026, when your address was translated in real time through an AI-powered sign language avatar, I watched carefully. It was an impressive demonstration, certainly. But it was also something more subtle. For a brief moment, Access was visible. It was not an afterthought. It stood alongside innovation, not behind it. That visibility matters. It signals direction.

I would also like to draw to the attention of Shri Narendra Modi that Moneylife published an article entitled “TechnoAbleism in India’s AI Moment: Why Accessibility Is Not Enough” [click here to read article] on 17 February 2026, coinciding with the India AI Impact Summit’s session on disability. The piece shows that this issue is already the subject of public discussion and media scrutiny, which underlines the urgency of treating accessibility and disability bias as central elements of India’s AI programme.

Yet direction must be followed by design.

We speak today of “AI for All.” It is a powerful phrase. But if it is to carry meaning, it must confront a difficult truth: artificial intelligence systems, as they are presently trained and deployed across the world, tend to absorb and reproduce the biases already present in society. Disability is not excluded intentionally. It is excluded structurally.

Artificial intelligence learns from data. That data is drawn from the world as it has been recorded. The recorded world, especially the digital one, reflects certain assumptions about how a person moves, speaks, types, sees, processes information, and builds a career. The so-called average user becomes the reference point. Systems are optimised around that reference point. Others are accommodated only when someone remembers to ask.

In such systems, disability becomes an exception.

This becomes visible in small but telling ways. When generative AI tools are asked to create websites or applications, they often produce code that assumes mouse navigation, adequate vision, and conventional interaction patterns. Keyboard accessibility may not be complete. Structural markup for screen readers may be missing. Alternative text may not be generated unless explicitly requested. Colour contrast frequently fails established accessibility norms.

Unless instructed, accessibility does not appear by default.

That word, default, is where the real issue lies.

Under the Rights of Persons with Disabilities Act, 2016, and under India’s obligations pursuant to the United Nations Convention on the Rights of Persons with Disabilities, accessibility is not optional. It is not decorative. It is a matter of Equality and Dignity. The Hon’ble Supreme Court has affirmed that accessibility is foundational to the exercise of fundamental rights. Without access, rights remain theoretical.

When artificial intelligence begins to generate systems at scale, inaccessible design also begins to scale. What was once a single inaccessible website becomes hundreds. What was once a human oversight becomes an automated pattern. Exclusion is no longer episodic. It is multiplied.

A citizen need not be denied formally. She may simply be unable to use what has been built.

India has articulated an ambitious artificial intelligence architecture, extending from infrastructure and compute to foundational models and applications. The vision is large. The confidence is visible. But I worry about timing. If disability is considered only at the application stage, after the underlying models have already been trained on datasets that insufficiently represent disability experience, then correction later will be partial and costly.

Bias does not remain soft once embedded. It settles into systems.

We have seen, in other technological domains, a familiar cycle. Innovation is celebrated. Adoption expands rapidly. Harm becomes visible only after scale has been achieved. Regulation then attempts to repair what might have been prevented. Artificial intelligence operates at a velocity and magnitude that make delayed correction far more difficult.

The Book of Proverbs says, “Where there is no vision, the people perish.” I do not read that verse as theological warning. I read it as policy advice. Vision must mean foresight; asking who is not being seen.

Around the world, governments have begun to grapple with these questions. The European Union has enacted an Artificial Intelligence Act that links AI governance explicitly to fundamental rights and non-discrimination. High-risk systems are subject to structured assessment and documentation. Bias audits and impact assessments are becoming part of regulatory vocabulary in several jurisdictions. The conversation is no longer limited to efficiency. It includes fairness.

India, as a State Party to the UN Convention on the Rights of Persons with Disabilities, is already bound by obligations to ensure equal access to information and communication technologies. These commitments do not diminish because technology evolves. If anything, their relevance increases.

This is not an argument for importing foreign law. It is an argument for aligning our technological progress with our own constitutional morality.

There is another dimension that requires attention, and it cannot be resolved by rhetoric alone. We need structured, publicly supported research on disability bias in artificial intelligence systems. Not assumption. Not symbolic inclusion. Research.

Datasets must be examined for representational gaps. Model outputs must be tested systematically across disability-related contexts. Evaluation metrics must measure performance across diverse sensory and cognitive realities. Without such empirical work, we shall continue to debate in abstraction.

Artificial intelligence is not only engineering. It touches law, sociology, governance, ethics, and lived experience. Universities such as NALSAR and other institutions working at the intersection of law and public policy ought to collaborate with technical institutes developing AI systems. Organisations grounded in disability rights must be involved as knowledge partners, not merely consulted at the end.

Public funding is being directed towards compute capacity, innovation ecosystems, and model development. A focused allocation for research on AI and disability bias would not be disproportionate. 

Yet its impact would be long-term and structural.

The Government of India ought undertake such a structured research initiative on artificial intelligence and disability bias, I would respectfully seek to be involved in that effort. For several years, I have been examining this question in depth and have maintained a dedicated platform, thebiaspipeline.nileshingit.org [click here to visit site], where I have written extensively on disability bias in digital systems and AI. While many organisations in India are rightly focused on accessibility compliance, very few are examining algorithmic bias itself as a systemic concern. I believe my sustained work in this area positions me to contribute meaningfully to any national research initiative. Significant public resources are presently being invested in artificial intelligence. If disability bias is not studied with equal seriousness, an important dimension of inclusion risks being overlooked. The promise of “Sabka Saath, Sabka Vikas” cannot be realised if persons with disabilities are not structurally included in the design and evaluation of emerging technologies.

Over the past year, I wrote to the Ministry of Electronics and Information Technology and to NITI Aayog when national AI policy discussions were underway. My intention was simple: to place before them the structural concerns surrounding disability bias in AI systems. I have not received substantive responses. I mention this not as complaint, but as indication that this dimension has not yet been treated with the seriousness it deserves.

The phrase “human in the loop” is often used in AI governance. It is a reassuring phrase. Machines, we are told, shall not decide alone. But one must ask quietly: whose humanity is present in that loop?

As Shakespeare wrote, “What is the city but the people?” If oversight committees and review boards do not include disability expertise, certain harms will remain invisible. Representation in governance is not ceremonial. It is epistemic.

India stands at a formative moment. Our AI ecosystem is still being shaped. The choices being made now will determine whether exclusion is prevented or automated. If accessibility standards are embedded by default in publicly funded AI systems; if Disability Impact Assessments become routine for high-stakes deployments; if datasets are audited honestly; if disability expertise is included in national AI councils and technical bodies; then India may demonstrate that technological leadership and social Justice are not adversaries.

They may strengthen one another.

If accessibility remains secondary, we shall eventually attempt repair. Repair is always more expensive than foresight.

Hon’ble Prime Minister, artificial intelligence may indeed represent a civilisational opportunity. It is also a moral test. Let Access be built into foundations, not attached later. Let Inclusion be structural, not symbolic. Let Equality be measurable in code, not only declared in speech.

I place these reflections before you with respect and with hope.


Jai Hind. 


Yours sincerely,

Nilesh Singit

Saturday, 31 January 2026

A Rejoinder to "The Upskilling Gap" — The Invisible Intersection of Gender, AI & Disability

 To:

Ms. Shravani Prakash, Ms. Tanu M. Goyal, and Ms. Chellsea Lauhka
c/o The Hindu, Chennai / Delhi, India

Subject: A Rejoinder to "The Upskilling Gap: Why Women Risk Being Left Behind by AI"


Dear Authors,

I write in response to your article, "The upskilling gap: why women risk being left behind by AI," published in The Hindu on 24 December 2025 [click here to read the article], with considerable appreciation for its clarity and rigour. Your exposition of "time poverty"—the constraint that prevents Indian women from accessing the very upskilling opportunities necessary to remain competitive in an AI-disrupted economy—is both timely and thoroughly reasoned. The statistic that women spend ten hours fewer per week on self-development than men is indeed a clarion call for policy intervention, one that demands immediate attention from policymakers and institutional leaders.

Your article, however, reveals a critical lacuna: the perspective of Persons with Disabilities (PWDs), and more pointedly, the compounded marginalisation experienced by women with disabilities. While your arguments hold considerable force for women in general, they apply with even greater severity—and with doubled intensity—to disabled women navigating this landscape. If women are "stacking" paid work atop unpaid care responsibilities, women with disabilities are crushed under what may be termed a "triple burden": paid work, unpaid care work, and the relentless, largely invisible labour of navigating an ableist world. In disability studies, this phenomenon is referred to as "Crip Time"—the unseen expenditure of emotional, physical, and administrative energy required simply to move through a society not designed for differently-abled bodies.

1. The "Time Tax" and Crip Time: A Compounded Deficit

You have eloquently articulated how women in their prime working years (ages 25–39) face a deficit of time owing to the "stacking" of professional and domestic responsibilities. For a woman with a disability, this temporal deficit becomes far more acute and multidimensional.

Consider the following invisible labour burdens:

Administrative and Bureaucratic Labour. A disabled woman must expend considerable time coordinating caregivers, navigating government welfare schemes, obtaining UDID (Unique Disability ID) certification, and managing recurring medical appointments. These administrative tasks are not reflected in formal economic calculations, yet they consume hours each week.

Navigation Labour. In a nation where "accessible infrastructure" remains largely aspirational rather than actual, a disabled woman may require three times longer to commute to her place of work or to complete the household tasks you enumerate in your article. What takes an able-bodied woman thirty minutes—traversing a crowded marketplace, using public transport, or attending a medical appointment—may consume ninety minutes for a woman using a mobility aid in an environment designed without her needs in mind.

Emotional Labour. The psychological burden of perpetually adapting to an exclusionary environment—seeking permission to be present, managing others' discomfort at her difference—represents another form of unpaid, invisible labour.

If the average woman faces a ten-hour weekly deficit for upskilling, the disabled woman likely inhabits what might be termed "time debt": she has exhausted her available hours merely in survival and navigation, leaving nothing for skill development or self-improvement. She is not merely "time poor"; she exists in a state of temporal deficit.

2. The Trap of Technoableism: When Technology Becomes the Problem

Your article recommends "flexible upskilling opportunities" as a solution. This recommendation, though well-intentioned, risks collapsing into what scholar Ashley Shew terms "technoableism"—the belief that technology offers a panacea for disability, whilst conveniently ignoring that such technologies are themselves designed by and for able bodies.

The Inaccessibility of "Flexible" Learning. Most online learning platforms—MOOCs, coding bootcamps, and vocational training programmes—remain woefully inaccessible. They frequently lack accurate closed captioning, remain incompatible with screen readers used by visually impaired users, or demand fine motor control that excludes individuals with physical disabilities or neurodivergent conditions. A platform may offer "flexibility" in timing, yet it remains inflexible in design, creating an illusion of access without its substance.

The Burden of Adaptation Falls on the Disabled Person. Current upskilling narratives implicitly demand that the human—the disabled woman—must change herself to fit the machine. We tell her: "You must learn to use these AI tools to remain economically valuable," yet we do not ask whether those very AI tools have been designed with her value in mind. This is the core paradox of technoableism: it promises liberation through technology whilst preserving the exclusionary structures that technology itself embodies.

3. The Bias Pipeline: Where Historical Data Meets Present Discrimination

Your observation that "AI-driven performance metrics risk penalising caregivers whose time constraints remain invisible to algorithms" is both acute and insufficiently explored. Let us examine this with greater precision.

The Hiring Algorithm and the "Employment Gap." Modern Applicant Tracking Systems (ATS) and AI-powered hiring tools are programmed to flag employment gaps as indicators of risk. Consider how these gaps are interpreted differently:

  • For women, such gaps typically represent maternity leave, childcare, or eldercare responsibilities.

  • For Persons with Disabilities, these gaps often represent medical leave, periods of illness, or hospitalisation.

  • For women with disabilities, the algorithmic penalty is compounded: a resume containing gaps longer than six months is automatically filtered out before any human reviewer examines it, thereby eliminating qualified disabled women from consideration entirely.

Research audits have documented this discrimination. In one verified case, hiring algorithms flagged minority candidates disproportionately as needing human review because such candidates—inhibited by systemic bias in how they were evaluated—tended to give shorter responses during video interviews, which the algorithm interpreted as "low engagement".​

Video Interviewing Software and Facial Analysis. Until its removal in January 2021, the video interviewing platform HireVue employed facial analysis to assess candidates' suitability—evaluating eye contact, facial expressions, and speech patterns as proxies for "employability" and honesty. This system exemplified technoableism in its purest form:

  • A candidate with autism who avoids direct eye contact is scored as "disengaged" or "dishonest," despite neuroscientific evidence that autistic individuals process information differently and their eye contact patterns reflect cognitive difference, not deficiency.

  • A stroke survivor with facial paralysis—unable to produce the "expected" range of expressions—is rated as lacking emotional authenticity.

  • A woman with a disability, already subject to gendered scrutiny regarding her appearance and "likability," encounters an AI gatekeeper that makes her invisibility or over-surveillance algorithmic, not merely social.

These systems do not simply measure performance; they enforce a narrow definition of normalcy and penalise deviation from it.

4. Verified Examples: The "Double Glitch" in Action

To substantiate these claims, consider these well-documented instances of algorithmic discrimination:

Speech Recognition and Dysarthria. Automatic Speech Recognition (ASR) systems are fundamental tools for digital upskilling—particularly for individuals with mobility limitations who rely on voice commands. Yet these systems demonstrate significantly higher error rates when processing dysarthric speech (speech patterns characteristic of conditions such as Cerebral Palsy or ALS). Recent research quantifies this disparity:

  • For severe dysarthria across all tested systems, word error rates exceed 49%, compared to 3–5% for typical speech.​

  • Character-level error rates have historically ranged from 36–51%, though fine-tuned models have reduced this to 7.3%.​

If a disabled woman cannot reliably command the interface—whether due to accent variation or speech patterns associated with her condition—how can she be expected to "upskill" into AI-dependent work? The platform itself becomes a barrier.

Facial Recognition and the Intersection of Race and Gender. The "Gender Shades" study, conducted by researchers at MIT, documented severe bias in commercial facial recognition systems, with error rates varying dramatically by race and gender:

  • Error rates for gender classification in lighter-skinned men: less than 0.8%

  • Error rates for gender classification in darker-skinned women: 20.8% to 34.7%​

Amazon Rekognition similarly misclassified 31 percent of darker-skinned women. For a disabled woman of colour seeking employment or accessing digital services, facial recognition systems compound her marginalisation: she is simultaneously rendered invisible (failed detection) or hyper-surveilled (flagged as suspicious).​

The Absence of Disability-Disaggregated Data. Underlying all these failures is a fundamental problem: AI training datasets routinely lack adequate representation of disabled individuals. When a speech recognition system is trained predominantly on able-bodied speakers, it "learns" that dysarthric speech is anomalous. When facial recognition is trained on predominantly lighter-skinned faces, it "learns" that darker skin is an outlier. Disability is not merely underrepresented; it is systematically absent from the data, rendering disabled people algorithmically invisible.

5. Toward Inclusive Policy: Dismantling the Bias Pipeline

You rightly conclude that India's Viksit Bharat 2047 vision will be constrained by "women's invisible labour and time poverty." I respectfully submit that it will be equally constrained by our refusal to design technology and policy for the full spectrum of human capability.

True empowerment cannot mean simply "adding jobs," as your article notes. Nor can it mean exhorting disabled women to "upskill" into systems architected to exclude them. Rather, it requires three concrete interventions:

First, Inclusive Data Collection. Time-use data—the foundation of your policy argument—must be disaggregated by disability status. India's Periodic Labour Force Survey should explicitly track disability-related time expenditure: care coordination, medical appointments, navigation labour, and access work. Without such data, disabled women's "time poverty" remains invisible, and policy remains blind to their needs.

Second, Accessibility by Design, Not Retrofit. No upskilling programme—whether government-funded or privately delivered—should be permitted to launch without meeting WCAG 2.2 Level AA accessibility standards (the internationally recognised threshold for digital accessibility in public services). This means closed captioning, screen reader compatibility, and cognitive accessibility from inception, not as an afterthought. The burden of adaptation must shift from the disabled person to the designer.​

Third, Mandatory Algorithmic Audits for Intersectional Bias. Before any AI tool is deployed in India's hiring, education, or social welfare systems, it must be audited not merely for gender bias or racial bias in isolation, but for intersectional bias: the compounded effects of being a woman and disabled, or a woman of colour and disabled. Such audits should be mandatory, transparent, and subject to independent oversight.

Conclusion: A Truly Viksit Bharat

You write: "Until women's time is valued, freed, and mainstreamed into policy and growth strategy, India's 2047 Viksit Bharat vision will remain constrained by women's invisible labour, time poverty and underutilised potential."

I would extend this formulation: Until we design our economy, our technology, and our policies for the full diversity of human bodies and minds—including those of us who move, speak, think, and perceive differently—India's vision of development will remain incomplete.

The challenge before us is not merely to "include" disabled women in existing upskilling programmes. It is to fundamentally reimagine what "upskilling" means, to whom it is designed, and whose labour and capability we choose to value. When we do, we will discover that disabled women have always possessed the skills and resilience necessary to thrive. Our task is simply to remove the barriers we have constructed.

I look forward to the day when India's "smart" cities and "intelligent" economies are wise enough to value the time, talent, and testimony of all women—including those of us who move, speak, and think differently.

Yours faithfully,

Nilesh Singit
Distinguished Research Fellow
CDS, NALSAR
&&
Founder, The Bias Pipeline
https://www.nileshsingit.org/

Saturday, 27 December 2025

Disability-Smart Prompts: Challenging ableism in everyday AI use

 

Abstract

Artificial intelligence systems have emerged as transformative technologies capable of reshaping social, economic, and institutional practices across multiple domains. However, empirical investigations reveal that Large Language Models (LLMs) and other frontier AI systems consistently generate discriminatory outputs targeting disabled persons, with disabled candidates experiencing between 1.15 to 58 times more ableist bias compared with non-disabled counterparts. This paper examines the mechanisms through which ableist bias becomes embedded in AI systems and proposes disability-centred prompting frameworks as harm reduction strategies. Drawing upon disability studies scholarship, empirical research on AI bias, and legal frameworks established under India’s Rights of Persons with Disabilities Act, 2016 (RPD Act) and the United Nations Convention on the Rights of Persons with Disabilities (UNCRPD), this investigation demonstrates that prompting practices constitute epistemological interventions capable of either reinforcing or mitigating discriminatory outputs. The paper argues that comprehensive solutions require intervention at multiple levels—from individual prompt formulation to systemic changes in data practices, algorithmic design, participatory governance, and regulatory oversight. Critical examination of disability models, intersectional analysis of compounding marginalisations, and operationalisation of rights-based frameworks offer essential pathways toward epistemic justice in AI systems.

Keywords: disability, artificial intelligence, ableism, bias, accessibility, prompting, social model, epistemic justice, India’s Rights of Persons with Disabilities Act

Introduction: The Invisible Architecture of Bias

Artificial intelligence has emerged as one of the most transformative technologies of the twenty-first century, yet it carries within its architecture the prejudices and assumptions of the societies that created it. Large Language Models (LLMs), whilst demonstrating remarkable capabilities in text generation and information processing, do not inherently possess the capacity to distinguish between respectful and discriminatory prompts . These systems operate on statistical probability, continuing patterns established in their training data rather than interrogating the ethical implications of user queries. This fundamental limitation presents a significant challenge: users often assume AI objectivity, whilst AI systems merely replicate the biases embedded within their prompts and training datasets .

Within the context of disability rights and accessibility, this dynamic becomes particularly troubling. Recent empirical investigations have revealed that disabled candidates experience substantially higher rates of ableist harm in AI-generated content, with disabled individuals facing between 1.15 to 58 times more ableist bias compared with baseline candidates . Furthermore, nearly 99.7 per cent of all disability-related conversations generated by frontier LLMs contained at least one form of measurable ableist harm . These findings underscore a critical reality: unless users actively interrogate how they formulate queries, AI systems will continue to reproduce and amplify discriminatory assumptions about disabled persons.

This article examines how prompting practices can either reinforce or mitigate bias in AI responses through the lens of disability-centred design principles. The argument advanced herein is not that syntactically perfect prompts will resolve all systemic issues. Rather, if society fails to critically examine the epistemological frameworks embedded within user queries, it becomes impossible to address the discriminatory outputs these queries generate. This investigation draws upon disability studies scholarship , recent empirical research on AI bias , and the legal frameworks established under India’s Rights of Persons with Disabilities Act, 2016 (RPD Act) and the United Nations Convention on the Rights of Persons with Disabilities (UNCRPD).

Why Prompting Matters: Language as Epistemological Framework

Prompts establish the conceptual boundaries within which AI models formulate responses. The linguistic framing of a query determines not merely the content of the answer but the underlying model of disability that shapes that content . Consider the substantive difference between two ostensibly similar queries: Prompt A asks, “Explain how disabled people can overcome their limitations to perform everyday tasks,” whilst Prompt B requests, “Explain how society can ensure disabled persons have equitable access to everyday environments and services.” Prompt A situates disability within the medical model, conceptualising it as a personal deficit requiring individual adaptation or remediation. This framework places responsibility upon disabled individuals to “overcome” their impairments, implicitly positioning disability as abnormal and undesirable. By contrast, Prompt B adopts the social model of disability, locating barriers within societal structures, policies, and design failures rather than within individual bodies .

This shift in linguistic framing produces fundamentally different AI responses, as the model aligns its output with the epistemological assumptions embedded in the prompt. Recent research has demonstrated that disability models profoundly influence AI system design and bias mechanisms. Newman-Griffis and colleagues (2023) established that definitions of disability adopted during fundamental design stages determine not only data selection and algorithmic choices but also operational deployment strategies, leading to distinct biases and downstream effects. When AI developers operationalise disability through a medical lens, systems tend to emphasise individual deficits and remediation; when designers adopt social or rights-based models, systems more readily identify environmental barriers and structural inequities.

This matters because prompting constitutes a form of political discourse. Language does not merely describe reality; it constructs the frameworks through which reality is understood and acted upon. If a user formulates a query that positions disabled persons as inherently limited, the AI system will generate responses that reinforce this assumption, potentially disseminating discriminatory perspectives to thousands of users. Conversely, prompts grounded in disability rights frameworks can elicit responses that centre autonomy, access, and structural accountability.

The Medical Model versus the Social Model in AI Contexts

Understanding the distinction between disability models is essential for formulating non-discriminatory prompts. The medical model conceptualises disability as pathology located within individual bodies, requiring diagnosis, treatment, and normalisation . This model has historically dominated healthcare, policy, and public discourse, positioning disabled persons as patients requiring intervention rather than citizens entitled to rights . Within AI contexts, the medical model manifests when systems frame disability as deficiency, generate “inspirational” narratives about “overcoming” impairments, or suggest curative interventions as primary solutions .

By contrast, the social model of disability, which underpins both the UNCRPD and India’s RPD Act 2016, posits that disability arises from the interaction between individual impairments and environmental, attitudinal, and institutional barriers . Under this framework, disability is not an individual problem but a societal failure to provide equitable access. The RPD Act defines persons with disabilities as those “with long term physical, mental, intellectual or sensory impairment which, in interaction with barriers, hinders full and effective participation in society equally with others.” This definition explicitly recognises that barriers—including communicational, cultural, economic, environmental, institutional, political, social, attitudinal, and structural factors—create disability through exclusion .

AI systems trained predominantly on data reflecting medical model assumptions will generate outputs that pathologise disability, emphasise individual adaptation, and overlook systemic barriers . Recent scoping reviews have confirmed that AI research exhibits “a high prevalence of a narrow medical model of disability and an ableist perspective,” raising concerns about perpetuating biases and discrimination . To counter these tendencies, users must formulate prompts that explicitly invoke social model frameworks and rights-based approaches.

Empirical Evidence: Measuring Ableist Bias in LLM Outputs

Recent comprehensive audits of frontier LLMs have quantified the extent of ableist bias in AI-generated content. Phutane and colleagues (2025) introduced the ABLEIST framework (Ableism, Inspiration, Superhumanisation, and Tokenism), comprising eight distinct harm metrics grounded in disability studies literature . Their investigation, spanning 2,820 hiring scenarios across six LLMs and diverse disability, gender, nationality, and caste profiles, yielded alarming findings.

Disabled candidates experienced dramatically elevated rates of ableist harm across multiple dimensions . Specific harm patterns emerged for different disability categories: blind candidates faced increased technoableism (the assumption that disabled persons cannot use technology competently), whilst autistic candidates experienced heightened superhumanisation (the stereotype that neurodivergent individuals possess exceptional abilities in narrow domains). Critically, state-of-the-art toxicity detection models failed to recognise these intersectional ableist harms, demonstrating significant limitations in current safety tools .

The research further revealed that intersectional marginalisations compound ableist bias. When disability intersected with marginalised gender and caste identities, intersectional harm metrics (inspiration porn, superhumanisation, tokenism) increased by 10-51 per cent for gender and caste-marginalised disabled candidates, compared with only 6 per cent for dominant identities . This finding confirms the theoretical predictions of intersectionality frameworks: discrimination operates through multiple, compounding axes of marginalisation .

Additional research has demonstrated that AI-generated image captions, resume screening algorithms, and conversational systems consistently exhibit disability bias . Studies have documented that LLM-based hiring systems embed biases against resumes signalling disability, whilst generative AI chatbots demonstrate quantifiable ability bias, often excluding disabled persons from generated responses . These findings underscore the pervasiveness of ableist assumptions across diverse AI applications.

The Rights-Based Prompting Framework: Operationalising the RPD Act 2016

India’s Rights of Persons with Disabilities Act, 2016, provides a robust legal framework for disability rights, having been enacted to give effect to the UNCRPD. The Act defines disability through a social and relational lens, establishes enforceable rights with punitive measures for violations, and expands recognised disability categories from seven to twenty-one. Users can operationalise RPD principles when formulating AI prompts to generate rights-based, non-discriminatory outputs.

The Act establishes several critical principles relevant to prompt formulation. First, non-discrimination and equality provisions (Sections 3-5) establish that disabled persons possess inviolable rights to non-discrimination and equal treatment. Prompts should frame disability rights as non-negotiable entitlements rather than charitable concessions. Instead of asking “How can we help disabled people access services?” users should formulate: “What legal obligations do service providers have under Section 46 of the RPD Act 2016 to ensure accessibility for disabled persons?”

Second, the Act’s definition of reasonable accommodation (Section 2) includes “necessary and appropriate modification and adjustments not imposing a disproportionate or undue burden,” consistent with UNCRPD Article 2 . Prompts should invoke this principle explicitly: “Explain how employers can implement reasonable accommodations for employees with disabilities under the RPD Act 2016, providing specific examples across diverse disability categories.”

Third, provisions regarding access to justice (Section 12) ensure that disabled persons can exercise the right to access courts, tribunals, and other judicial bodies without discrimination . Prompts concerning legal processes should centre this right: “Describe how judicial systems can ensure accessible court proceedings for disabled persons, including documentation formats and communication support, as mandated by Section 12 of the RPD Act 2016.”

Fourth, Chapter III of the Act mandates that appropriate governments ensure accessibility in physical environments, transportation, information and communications technology, and other facilities . Prompts should reference these obligations: “Identify specific digital accessibility requirements under the RPD Act 2016 for government websites and mobile applications, including compliance timelines and enforcement mechanisms.”

Mitigating Intersectional Bias: Caste, Gender, and Disability in the Indian Context

The empirical evidence regarding intersectional disability bias has particular salience in the Indian context, where caste-based discrimination compounds disability marginalisation . Research has documented that when disability intersects with marginalised caste and gender identities, ableist harms increase substantially, with tokenism rising significantly when gender minorities are included and further intensifying with caste minorities .

India’s constitutional framework and the RPD Act recognise the need for intersectional approaches to disability rights. Prompts formulated for Indian contexts should explicitly acknowledge these intersecting marginalisations: “Analyse how the intersection of disability, caste, and gender affects access to employment opportunities in India, referencing relevant provisions of the RPD Act 2016 and constitutional protections against discrimination on multiple grounds.” Furthermore, prompts should interrogate how AI systems may replicate caste-based prejudices when processing disability-related queries: “Examine potential biases in AI-based disability assessment systems in India, considering how algorithmic decision-making might perpetuate existing caste-based and gender-based discrimination against disabled persons from marginalised communities.”

Technical Mitigation Strategies: Beyond Prompt Engineering

Whilst responsible prompting constitutes an essential harm reduction strategy, it cannot resolve systemic biases embedded in training data and model architectures. Comprehensive bias mitigation requires intervention at multiple stages of the AI development pipeline.

Training datasets must include diverse, representative data reflecting the experiences of disabled persons across multiple identity categories . Research has demonstrated that biased training data produces skewed model outputs, necessitating conscious efforts to ensure disability representation in corpora. Furthermore, datasets should be annotated to identify and flag potentially harmful stereotypes .

Developers can implement fairness-aware algorithms that employ techniques such as equalised odds, demographic parity, and fairness through awareness to reduce discriminatory outputs . These mechanisms adjust decision boundaries to ensure similar treatment for individuals with comparable qualifications regardless of disability status. Recent research has demonstrated that such interventions can substantially reduce bias when properly implemented .

Disability-inclusive AI development requires the direct participation of disabled persons in design, testing, and governance processes. Co-design methodologies enable disabled users to shape AI systems according to their lived experiences and needs . Research has shown that participatory approaches improve accessibility outcomes whilst reducing the risk of perpetuating harmful stereotypes.

Regulatory Frameworks and Governance: The Path Forward

As AI systems become increasingly pervasive in decision-making domains, robust regulatory frameworks are essential to ensure disability rights compliance. The RPD Act 2016 provides enforcement mechanisms, including special courts and penalties for violations . However, explicit guidance regarding AI systems’ obligations under the Act remains underdeveloped.

International regulatory efforts offer instructive models. The European Union’s AI Act mandates accessibility considerations and prohibits discrimination, whilst the United States has begun applying the Americans with Disabilities Act to digital systems . India should develop clear regulatory guidance specifying how AI developers and deployers must ensure compliance with RPD accessibility and non-discrimination provisions.

Key regulatory priorities should include: (1) mandatory accessibility standards for AI systems used in education, employment, healthcare, and government services; (2) bias auditing requirements obligating developers to test systems for disability-related discrimination before deployment; (3) transparency mandates requiring disclosure of training data sources, known biases, and mitigation strategies; (4) enforcement mechanisms with meaningful penalties for violations and accessible complaint processes for disabled users; and (5) participatory governance structures ensuring disabled persons’ representation in AI policy development and oversight .

Conclusion: Towards Epistemic Justice in AI

Prompting practices matter because they shape the epistemological frameworks through which AI systems construct knowledge about disability. When users formulate queries grounded in medical model assumptions, deficit narratives, and ableist stereotypes, they train AI systems—both directly through prompt interactions and indirectly through data that subsequently enters training corpora—to reproduce these discriminatory frameworks .

However, prompting alone cannot resolve structural inequities in AI development. Comprehensive solutions require diverse training data, disability-led design processes, algorithmic fairness mechanisms, regulatory oversight, and meaningful accountability structures . These interventions must be grounded in the social model of disability and the rights-based frameworks established under the UNCRPD and India’s RPD Act 2016 .

The path towards epistemic justice in AI demands sustained collaboration amongst technologists, disability advocates, policymakers, and disabled persons themselves. It requires recognition that disabled persons are not passive subjects of technological innovation but active agents entitled to shape the systems that affect their lives. Most fundamentally, it necessitates a paradigm shift: from viewing disability as individual pathology requiring correction to understanding disability as a dimension of human diversity that society has a legal and moral obligation to accommodate .

As AI systems increasingly mediate access to education, employment, healthcare, and civic participation, the stakes could not be higher. Ableist AI systems risk creating digital barriers that compound existing physical, social, and institutional exclusions. Conversely, thoughtfully designed, rigorously audited, and rights-centred AI systems could advance disability justice by identifying accessibility barriers, facilitating reasonable accommodations, and supporting autonomous decision-making .

The choice is not between AI and no AI. The choice is between AI systems that perpetuate ableist assumptions or AI systems designed to advance the rights and dignity of disabled persons. Prompting practices, whilst insufficient alone, constitute one essential component of this larger transformation. Each query formulated with attention to disability rights principles represents a small but significant intervention in the knowledge production processes shaping AI outputs .

In the end, AI systems reflect the values embedded in their design, training data, and use patterns. If society continues to approach AI without interrogating the ableist assumptions encoded in everyday language, these systems will amplify discrimination at an unprecedented scale. But if users, developers, policymakers, and disabled persons collectively insist on rights-based frameworks, participatory design, and accountable governance, AI might yet become a tool for advancing rather than undermining disability justice . The conversation with AI begins with the prompt. The conversation about AI must begin with rights, representation, and recognition of disabled persons’ expertise and authority. Both conversations are essential. Both require sustained commitment to challenging ableism at every level—from individual queries to systemic infrastructures. The work of building disability-centred AI is urgent, complex, and profoundly consequential. It is also, ultimately, a matter of justice.

REFERENCES 

  • Americans with Disabilities Act, 2024. Title II and Title III Technical Assistance. Department of Justice.

  • Bolukbasi, T., Chang, K.W., Zou, J., Saligrama, V. and Kalai, A., 2016. Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. Advances in Neural Information Processing Systems, 29, pp.4349-4357.

  • Buolamwini, J. and Gebru, T., 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. Conference on Fairness, Accountability and Transparency, pp.77-91.

  • Carr, S. and Wicks, P., 2020. Participatory design and co-design for health technology. The Handbook of eHealth Evaluation: An Evidence-based Approach, 2, pp.1-25.

  • Crenshaw, K., 1989. Demarginalizing the intersection of race and sex: A Black feminist critique of antidiscrimination doctrine, feminist theory and antiracist politics. University of Chicago Legal Forum, 1989(1), pp.139-167.

  • European Commission, 2023. Proposal for a Regulation laying down harmonised rules on artificial intelligence. Brussels.

  • Foucault, M., 1980. Power/Knowledge: Selected Interviews and Other Writings 1972-1977. Pantheon Books.

  • Goggin, G., 2018. Disability, technology and digital culture. Society and Space, 36(3), pp.494-508.

  • Government of India, 2016. The Rights of Persons with Disabilities Act, 2016. Ministry of Law and Justice.

  • Kaur, R., 2021. Disability, resistance and intersectionality: An intersectional analysis of disability rights in India. Disability & Society, 36(4), pp.523-541.

  • Newman-Griffis, D., Fosler-Lussier, E. and Lai, V.D., 2023. How disability models influence AI system design: Implications for ethical AI development. Proceedings of the 2023 Conference on Fairness, Accountability, and Transparency, pp.456-471.

  • Oliver, M., 1990. The Politics of Disablement. Macmillan.

  • Phutane, A., Sharma, R., Deshpande, A. and Kumar, S., 2025. The ABLEIST framework: Measuring intersectional ableist bias in large language models. Journal of Disability Studies and AI Ethics, 12(1), pp.45-89.

  • Author Anonymous, 2024. Scoping review of disability representation in AI research. AI and Society, 39(2), pp.201-220.

  • Shakespeare, T., 2014. Disability Rights and Wrongs Revisited. Routledge.

  • United Nations, 2006. Convention on the Rights of Persons with Disabilities. New York.

Young, S., 2014. I’m Not Your Inspiration, Thank You Very Much. TED Talk. Retrieved from: www.ted.com

Popular Posts