ESG Data Quality & Challenges

ESG data quality represents a critical challenge for investors, companies, and policymakers seeking to assess environmental, social, and governance performance, with persistent issues including limited data availability, inconsistent methodologies, inadequate verification, and substantial gaps in coverage across companies, geographies, and ESG topics.¹ Unlike financial data governed by established accounting standards and subject to mandatory audit requirements, ESG data historically relied on voluntary disclosure with limited standardization, creating substantial variation in what companies report, how they measure performance, and how data providers aggregate information into ratings and scores. These data quality challenges undermine ESG integration effectiveness, create opportunities for greenwashing, complicate performance comparison, and raise questions about whether ESG assessments reflect genuine sustainability performance or measurement artifacts. While regulatory developments including mandatory climate disclosure, sustainability reporting standards (ISSB, EU ESRS), and assurance requirements are improving ESG data quality, significant challenges persist particularly for private companies, small and medium enterprises, emerging markets, and social and governance metrics that lack established measurement methodologies.

ESG data quality issues manifest across the data value chain from company measurement and disclosure through data provider collection and processing to investor analysis and decision-making. Companies face challenges in measuring ESG performance given lack of established methodologies for many metrics, limited internal systems for ESG data collection, and resource constraints particularly for smaller companies. Data providers face challenges in collecting data from diverse sources, standardizing information across companies and geographies, filling gaps where disclosure is limited, and making subjective judgments about materiality and weighting. Investors face challenges in assessing data reliability, comparing performance across companies with different disclosure practices, and determining which ESG metrics are material to investment decisions. Addressing these challenges requires continued standardization efforts, enhanced disclosure requirements, improved verification and assurance, technological solutions for data collection and analysis, and realistic expectations about ESG data limitations.

Data Availability and Coverage Gaps

ESG data availability varies substantially across companies, geographies, and ESG topics, with significant coverage gaps limiting comprehensive ESG assessment.²

Company Size Disparities are pronounced, with large publicly traded companies providing extensive ESG disclosure while small and medium enterprises (SMEs) and private companies often provide minimal ESG information. This disparity reflects resource constraints (ESG reporting requires dedicated staff and systems), regulatory requirements (large public companies face more disclosure mandates), and stakeholder pressure (large companies face greater investor and civil society scrutiny). Coverage gaps for SMEs and private companies create challenges for supply chain ESG assessment, private equity ESG integration, and comprehensive market ESG analysis. Data providers often lack coverage of smaller companies or rely on estimated data based on sector averages.

Geographic Disparities reflect variation in disclosure requirements, corporate governance norms, and data provider coverage across regions. European and North American companies generally provide more extensive ESG disclosure than companies in emerging markets, reflecting more stringent regulatory requirements and stronger stakeholder expectations in developed markets. However, emerging market companies may face more material ESG risks, creating information gaps where data is most needed. Data provider coverage is often limited in emerging markets, with providers relying on estimates or excluding companies from coverage.

Topic Coverage Variation shows environmental data (particularly greenhouse gas emissions and energy use) having better availability than social data (labor practices, human rights, community impacts) and some governance data (board effectiveness, corporate culture). This variation reflects established environmental measurement methodologies, regulatory focus on climate disclosure, and greater difficulty in measuring social and governance factors. Social metrics including human rights impacts, supply chain labor practices, and community relations often lack standardized measurement approaches and rely on qualitative assessment. Governance metrics including board effectiveness, corporate culture, and stakeholder engagement are difficult to quantify and often assessed through proxy indicators.

Supply Chain Data Gaps represent critical challenge given that supply chain impacts often exceed direct operations impacts, particularly for Scope 3 emissions, labor practices, and human rights risks. Companies often lack visibility into supply chain ESG performance, particularly for multi-tier supply chains, and rely on supplier self-assessment or industry averages. Supply chain data gaps limit comprehensive ESG assessment and create risks of missing material impacts.

Historical Data Limitations arise from ESG disclosure being relatively recent practice, with many companies having limited historical ESG data. This limits longitudinal analysis, trend assessment, and evaluation of ESG performance improvements over time. Historical data gaps are particularly pronounced for newer ESG metrics and for companies that recently began ESG reporting.

Measurement and Methodology Challenges

ESG measurement faces methodological challenges arising from lack of established standards, subjective judgment requirements, and complexity of sustainability performance assessment.³

Lack of Standardized Definitions for many ESG metrics creates inconsistency in what companies report and how data providers assess performance. Terms like "sustainable," "green," "ethical," and even specific metrics like "diversity" lack universal definitions, enabling companies to define metrics in ways that present performance favorably. While standardization efforts including GRI, SASB, and ISSB are addressing this challenge, many ESG metrics remain poorly defined, particularly for social and governance factors.

Boundary and Scope Decisions require subjective judgments about what to include in ESG metrics, such as which emissions sources to include in carbon footprints (Scope 1, 2, and/or 3), which entities to include in workforce metrics (direct employees, contractors, supply chain workers), and which time periods to assess. Different boundary decisions can produce substantially different ESG performance assessments for the same company. Companies may make boundary decisions that present performance favorably, while data providers may make different boundary assumptions when estimating data, creating inconsistencies.

Estimation and Modeling are widely used by data providers to fill disclosure gaps, with estimates sometimes comprising majority of ESG data for companies with limited disclosure. Estimation methodologies vary across providers and are often opaque, creating uncertainty about data accuracy. While estimation enables broader coverage, it introduces error and may not capture company-specific performance. Research finds that estimated ESG data has lower correlation with actual performance than disclosed data, raising questions about estimated data reliability.

Materiality Assessment Subjectivity requires judgments about which ESG factors are material to which companies, with different stakeholders and frameworks taking different approaches. Financial materiality focuses on ESG factors affecting enterprise value, while double materiality includes impacts on society and environment. Materiality assessments involve subjective judgments about issue significance, time horizons, and stakeholder perspectives. Different materiality approaches can lead to different ESG assessments for the same company.

Aggregation and Weighting challenges arise from combining diverse ESG factors into ratings or scores, requiring subjective decisions about how to weight different factors. There is no objective basis for determining whether environmental performance should be weighted more heavily than social performance, or how to weight different environmental issues against each other. Different weighting approaches can produce substantially different ESG ratings for the same company, contributing to rating divergence across providers.

Forward-Looking vs. Backward-Looking tensions arise from most ESG data reflecting historical performance while investment decisions require forward-looking risk and opportunity assessment. Historical ESG performance may not predict future ESG risks, particularly for rapidly evolving issues like climate transition risks or emerging social expectations. Incorporating forward-looking assessment requires subjective judgment about future trends and company responses.

Verification and Assurance Gaps

ESG data often lacks independent verification and assurance, creating opportunities for inaccuracy and misrepresentation.⁴

Limited Assurance Requirements mean that most ESG disclosure is unaudited, with companies self-reporting ESG metrics without independent verification. While some companies voluntarily obtain limited or reasonable assurance for sustainability reports, assurance is not universally required and often covers only selected metrics. Limited assurance (lower level of verification) is more common than reasonable assurance (equivalent to financial audit standards), with limited assurance providing less confidence in data accuracy. Regulatory developments including EU CSRD are introducing mandatory assurance requirements, but global assurance coverage remains limited.

Assurance Scope Limitations mean that even when assurance is obtained, it often covers only selected ESG metrics rather than comprehensive sustainability disclosure. Companies may obtain assurance for metrics where performance is strong while leaving other metrics unassured, creating selective verification. Assurance scope limitations reduce overall confidence in ESG data quality.

Assurance Provider Variation in qualifications, methodologies, and rigor creates inconsistency in assurance quality. Assurance may be provided by accounting firms, specialized sustainability assurance providers, or certification bodies, with varying standards and approaches. Some assurance providers have limited ESG expertise, while others have potential conflicts of interest from providing both assurance and consulting services. Assurance quality variation means that not all assurance provides equivalent confidence in data accuracy.

Assurance Standards Inconsistency reflects lack of universal assurance standards for ESG data, with providers using different standards including ISAE 3000, AA1000AS, and proprietary approaches. Different standards have different requirements for evidence gathering, materiality assessment, and reporting, creating variation in assurance rigor. Standardization efforts including IAASB's work on sustainability assurance standards aim to address this inconsistency.

Cost and Resource Constraints limit assurance adoption, particularly for smaller companies, with assurance representing significant cost and requiring internal resources to support assurance process. Cost-benefit considerations lead many companies to forgo assurance or obtain limited assurance for selected metrics only. Resource constraints are particularly acute for SMEs and companies in emerging markets.

Rating Divergence and Comparability Issues

ESG rating divergence across rating agencies is substantially higher than credit rating divergence, creating confusion and comparability challenges.⁵

Rating Correlation between major ESG rating agencies is around 0.5-0.7, compared to 0.9+ for credit ratings, indicating substantial disagreement about company ESG performance. This divergence means that a company may receive high ESG rating from one agency and low rating from another, creating confusion for investors and companies. Rating divergence reflects differences in scope (which ESG issues are assessed), measurement (how issues are quantified), and weighting (how issues are aggregated).

Scope Differences across rating agencies include variation in which ESG factors are assessed, with some agencies emphasizing environmental factors while others weight social or governance factors more heavily. Agencies also differ in whether they assess ESG risks, ESG opportunities, or both, and in whether they consider stakeholder impacts (double materiality) or only financially material factors. These scope differences mean that agencies are effectively measuring different constructs, explaining some rating divergence.

Measurement Differences arise from agencies using different data sources, making different boundary decisions, and applying different estimation methodologies when disclosure is limited. Agencies may interpret the same disclosure differently or make different assumptions when estimating missing data. Measurement differences contribute substantially to rating divergence, with research finding that measurement differences explain more rating divergence than scope or weighting differences.

Weighting Differences reflect agencies' subjective judgments about relative importance of different ESG factors, with no objective basis for determining optimal weights. Some agencies use sector-specific weights reflecting materiality, while others use consistent weights across sectors. Weighting differences contribute to rating divergence, though less than measurement differences.

Implications for Users include difficulty in determining which rating to trust, opportunities for companies to engage in ratings shopping (selectively disclosing favorable ratings), and challenges in comparing ESG performance across companies assessed by different agencies. Rating divergence reduces confidence in ESG ratings and creates implementation challenges for ESG integration. However, some research suggests that rating divergence may reflect legitimate methodological pluralism rather than measurement error, with different ratings capturing different aspects of ESG performance.

Technological Solutions and Innovations

Technology is increasingly applied to ESG data challenges, with innovations including satellite monitoring, natural language processing, and blockchain for supply chain traceability.⁶

Satellite and Remote Sensing technologies enable independent verification of environmental metrics including deforestation, emissions, water use, and land use changes. Satellite data provides objective, comprehensive coverage that doesn't rely on company disclosure, enabling verification of company claims and identification of unreported impacts. However, satellite data has limitations including inability to measure some impacts (e.g., chemical pollution), interpretation challenges, and cost.

Natural Language Processing and AI are applied to analyze corporate disclosures, news articles, and other text sources to extract ESG information and identify ESG risks. NLP can process large volumes of text more efficiently than manual analysis, enabling broader coverage and more timely identification of ESG issues. However, NLP faces challenges in understanding context, assessing materiality, and avoiding bias in training data.

Blockchain and Distributed Ledger technologies are explored for supply chain traceability, enabling verification of product origins, labor practices, and environmental impacts through immutable records. Blockchain could address supply chain data gaps by creating transparent, verifiable records of product journey from source to consumer. However, blockchain adoption faces challenges including cost, scalability, and verification of data entered into blockchain (garbage in, garbage out problem).

IoT and Sensor Networks enable real-time monitoring of environmental metrics including emissions, energy use, and water consumption, providing more accurate and timely data than periodic manual measurement. IoT could improve environmental data quality and enable dynamic ESG assessment. However, IoT deployment requires infrastructure investment and faces data management challenges.

Data Standardization Platforms including CDP, SASB, and GRI provide standardized frameworks and platforms for ESG disclosure, improving data comparability and quality. Digital reporting platforms with built-in validation and structured data formats can reduce reporting errors and improve data usability. However, platform adoption requires company investment and may face resistance from companies preferring flexible disclosure.

Future Directions

ESG data quality is improving through regulatory mandates, standardization efforts, technology adoption, and market maturation. Mandatory disclosure requirements including EU CSRD and proposed SEC climate rules will enhance data availability and comparability. ISSB standards provide global baseline for sustainability disclosure, driving standardization. Assurance requirements are expanding, improving data reliability. Technology adoption is enabling independent verification and broader coverage. However, challenges will persist particularly for private companies, SMEs, emerging markets, and social metrics lacking established measurement methodologies. Realistic expectations about ESG data limitations, continued investment in data infrastructure, and ongoing standardization efforts will be necessary to support effective ESG integration.

References

Key Resources

• ISSB Standards Navigator
• GRI Standards