Entropy and diversity
2006/02/23 by Lou Jost · 4,690 citations
Agricultural and Biological Sciences · Biochemistry, Genetics and Molecular Biology · Environmental Science · Mathematics · #Biology #Cluster analysis #Computer science #Data mining #Diversity index #Ecology #Ecology and Vegetation Dynamics Studies #Entropy (arrow of time) #Generalized entropy index #Index (typography) #Insect and Arachnid Ecology and Behavior #Jaccard index #Mathematics #Measure (data warehouse) #Physics #Plant and animal studies #Species richness #Statistics #Transformation (genetics)
paper · doi:10.1111/j.2006.0030-1299.14714.x
published in Oikos 113(2), 363-375 (Wiley)
openalex publication_date 2006/02/23 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/06
Abstract
Entropies such as the Shannon–Wiener and Gini–Simpson indices are not themselves diversities. Conversion of these to effective number of species is the key to a unified and intuitive interpretation of diversity. Effective numbers of species derived from standard diversity indices share a common set of intuitive mathematical properties and behave as one would expect of a diversity, while raw indices do not. Contrary to Keylock, the lack of concavity of effective numbers of species is irrelevant as long as they are used as transformations of concave alpha, beta, and gamma entropies. The practical importance of this transformation is demonstrated by applying it to a popular community similarity measure based on raw diversity indices or entropies. The standard similarity measure based on untransformed indices is shown to give misleading results, but transforming the indices or entropies to effective numbers of species produces a stable, easily interpreted, sensitive general similarity measure. General overlap measures derived from this transformed similarity measure yield the Jaccard index, Sørensen index, Horn index of overlap, and the Morisita–Horn index as special cases.
Cited by
- Final Late Holocene plant resources and paleoenvironmental changes in the eastern part of the Beagle Channel (Tierra del Fuego, Argentina)
- Active wetland restoration kickstarts vegetation establishment, but natural development promotes greater plant diversity
- Root diameter, host specificity and arbuscular mycorrhizal fungal community composition among native and exotic plant species
- Post-Hurricane Successional Dynamics in Abundance and Diversity of Canopy Arthropods in a Tropical Rainforest
- Fire frequency shapes diversity in multi‐guild communities through direct and indirect pathways
- Does pollen-assemblage richness reflect floristic richness? A review of recent developments and future challenges
- Variation in the diversity and composition of tree-related microhabitats across climate and human impact gradients on a tropical mountain
- LP-SFT: Local-Preserving Supervised Fine-Tuning via Multimodal Entropy Structure
- A Centrality Measure Using Magnitude Homology
- Quantifying the complexity of trajectory ensembles with clustering-weighted multivariate multiscale sample entropy
- No need to seed: restoring species‐rich grassland on former arable fields by natural regeneration
- Biodiversity resilience in a tropical rainforest
- Plant diversity induces shifts from microbial generalists to specialist by enhancing niche differentiation, microbiome connectivity, and network stability in a temperate grassland
- Epistemic Diversity and Knowledge Collapse in Large Language Models
- Does Participatory Bird Monitoring Provide Accurate Data for Ecological Research? An Experience in Rural Southwestern Mexico
- Habitat and land‐use intensity shape moth community structure across temperate forest and grassland
- Invasive plants decrease arbuscular mycorrhizal fungal diversity and promote generalist fungal partners
- Functional connectivity of animal-dispersed plant communities depends on the interacting effects of network specialization and resource diversity
- Dietary Breadth Predicts Toxin Expression Complexity in the Venoms of North American Gartersnakes
- Contrasting responses of above- and belowground carbon stocks and arthropods in relation to forest management
- Diversity and biogeography of the bacterial microbiome in glacier-fed streams
- Interdisciplinarity Revealed by Transitive Reduction of Citation Networks
- The impact of gigafire on vegetation structure, terrestrial vertebrate abundance and diel activity
- Lichen-derived atranorin effects on cultivable gut-associated bacteria in Constrictotermes cyphergaster
- Fungi-substrate association patterns in boreal forests
- Scale‐Dependent Effects of Plant Diversity Drivers Across Different Grassland Habitats in Ukraine
- Information Theory and Population Genetics
- Scalably computing metric magnitude
- Multi-Fingered Active Grasp Learning
- Methods for diversity and overlap analysis in T-cell receptor populations
- Linear Decision Tree Policies for Integer Linear Programs
- Epistemic diversity across language models mitigates knowledge collapse
- Measuring cultural and ethnic diversity in research and innovation
- Which Similarity-Sensitive Entropy (Sentropy)?
- Plasticity and Adaptation of Northern California Eelgrass in Response to Sediment Conditions
- Generalized Maximum Entropy: When and Why you need it
- Sparse Continuous Distributions and Fenchel-Young Losses
- Testing the potential of pollen assemblages to capture composition, diversity and ecological gradients of surrounding vegetation in two biogeographical regions of southeastern Europe
- Spatial and temporal comparisons of salt marsh soil fungal communities following the deepwater horizon spill
- Higher trophic levels and species with poorer dispersal traits are more susceptible to habitat loss on island fragments
- Harmonising digitised herbarium data to enhance biodiversity knowledge: Major steps towards an updated checklist for the flora of Greenland
- rarestR : An R Package Using Rarefaction Metrics to Estimate α‐ and β‐Diversity for Incomplete Samples
- Vertebrate community composition and activity at giant otter latrines in the northern Pantanal
- Anthropogenic land consolidation intensifies zoonotic host diversity loss and disease transmission in human habitats
- Historical Lead Contamination Linked to Atmospheric Deposition is Associated With Declines in Ectomycorrhizal Diversity and Shifts in Fungal Community Composition
- Mathematically and biologically consistent framework for presence–absence pairwise indices
- Reef fish biophony under tourism-driven sound pollution in Northeastern Brazil
- Antiretroviral treatment does not prevent extrapulmonary tuberculosis during SIV/Mtb coinfection in macaques
- From Low‐Loaded Mesophilic to High‐Loaded Thermophilic Anaerobic Digestion: Changes in Reactor Performance and Microbiome
- Structural and Compositional Disturbance Legacies Mediate the Resistance of European Forests to Repeated Disturbances
- The Minor Fall, the Major Lift: Inferring Emotional Valence of Musical Chords through Lyrics
- Landscape context influences local management effects on birds and bats in Amazonian cacao agroforestry systems
- Chronic anthropogenic disturbance mediates the biodiversity‐productivity relationship across stand ages in a large temperate forest region
- Quantifying Ambiguity in Categorical Annotations: A Measure and Statistical Inference Framework
- Southeast Asian biodiversity is a fifth lower in deforested versus intact forests
- Modelling of Soil Multifunctionality Across Europe
- Manipulating vector transmission reveals local processes in Bartonella communities of bats
- Network entropy as a key to the past: A quantitative approach to complex social networks
- Exploiting TCR Repertoire Analysis to Select Therapeutic TCRs for Cancer Immunotherapy
- Understanding the chemodiversity of plants: Quantification, variation and ecological function
- Phylogenetic reconstruction of the cultural evolution of electronic music via dynamic community detection (1975–1999)
- Networks in a World Unknown: Public WhatsApp Groups in the Venezuelan Refugee Crisis
- Peeling metric spaces of strict negative type
- Mathematical basis for the assessment of antibiotic resistance and administrative counter-strategies
- Forest patches as important bird habitats in Malaysia's large-scale infrastructure development areas
- Cultural innovation can increase and maintain biodiversity: A case study from medieval Europe
- Real communities of virtual plants explain biodiversity on just three assumptions
- Hunting habits die hard: Conserved prey preferences in army ants across two distant neotropical rainforests
- Atlantic lowland forests face shifts in composition and structure under climatic change
- Scientific selection: A century of increasing crop varietal diversity in US wheat
- Biodiversity loss in a gradient of urbanization: rodent community structure in a subtropical area of Northern Argentina
- The scale dependency of spatial crop species diversity and its relation to temporal diversity
- Cross-domain diversity effects: linking diatom species richness, intraspecific richness, and biomass production to host-associated bacterial diversity
- Acoustic indices can be driven by habitat characteristics rather than bird diversity
- The selectiveness of inclusiveness: exploring the influence of traditional religious visage on contemporary cultural tastes
- Nutrient coverage of China’s plant-based food supply can be improved with food system adjustments
- Drivers of arable flora diversity in productive Mediterranean pulse cropping systems
- ACDC: α-Carving Decision Chain for Risk Stratification
- Sparse and Continuous Attention Mechanisms
- sentropy: A Python Package for Revealing Hidden Differences in Complex Datasets
- Allotaxonometry and rank-turbulence divergence: A universal instrument for comparing complex systems
- Betweenness and Diversity in Journal Citation Networks as Measures of Interdisciplinarity -- A Tribute to Eugene Garfield --
- A Theory of Information, Variation, and Artificial Intelligence
- Collab-REC: An LLM-based Agentic Framework for Balancing Recommendations in Tourism
- Malware "Ecology" Viewed as Ecological Succession: Historical Trends and Future Prospects
- Adelic Models of Percolation
- The Microflora Danica atlas of Danish environmental microbiomes
- Population suppression of urban common mynas (Acridotheres tristis) by citizens: short-term effects on local avifauna and succession among the despots
- DECOMPOSING LITHIFICATION BIAS: PRESERVATION OF LOCAL DIVERSITY STRUCTURE IN RECENTLY CEMENTED STORM-BEACH CARBONATE SANDS, SAN SALVADOR ISLAND, BAHAMAS
- Biodiversity of Coreoidea and Pentatomidae (Heteroptera) from Atlantic forest protected areas. Insights into their conservation.
- A survey of diversity quantification in natural language processing: The why, what, where and how
- Equivalence relations on ecosystems
- Diversity of dung beetles (Coleoptera: Scarabaeinae) from the Pampas del Heath, Bahuaja Sonene National Park – Peru: new country records
- The emerging sectoral diversity of startup ecosystems
- Perplexity as a Metric for Isoform Diversity in the Human Transcriptome
- Bayesian-Guided Diversity in Sequential Sampling for Recommender Systems
- Land‐use history determines stand structure and tree diversity in vanilla agroforests of northeastern Madagascar
- An extreme storm decreases reef fish abundance and richness but does not impact spatial heterogeneity
- The Lock-in Hypothesis: Stagnation by Algorithm
- The application of mixed-use measures at the pedestrian-scale
- KOBAS-i: intelligent prioritization and exploratory visualization of biological functions for gene enrichment analysis
- How to partition diversity
- Natural and fishing disturbances combine to drive seafloor conservation outcomes from spatial closures on Georges Bank
- Optimizing an integrated biovigilance toolbox to study the spatial distribution and dynamic changes of airborne mycobiota, with a focus on cereal rust fungi in western Canada
- Understandable multifunctionality measures using Hill numbers
- A diversity of beta diversities: straightening up a concept gone awry. Part 1. Defining beta diversity as a function of alpha and gamma diversity
- A diversity of beta diversities: straightening up a concept gone awry. Part 2. Quantifying beta diversity and related phenomena
- A consistent terminology for quantifying species diversity? Yes, it does exist
- Beetle (Coleoptera) communities inside and outside the pest-resistant fencing of a New Zealand ecosanctuary
- Peel neighborhoods
- Distribution of plastic polymer types in the marine environment; A meta-analysis
- Revising price coordination in the classical and neoclassical economics based on elementary cellular automata
- Riqueza de aves en la Reserva de la Biosfera Sierra del Abra Tanchipa en San Luis Potosí, México
- Distribution, diversity, endemism, and ecology of Nymphalid butterflies (Lepidoptera: Nymphalidae) in the Loxicha Region, Oaxaca, Mexico
- Structural changes of marine communities over the Permian–Triassic transition: Ecologically assessing the end-Permian mass extinction and its aftermath
- Competition in slow motion: the unusual case of benthic marine communities in the wake of the end‐Permian mass extinction
- Complete biotic and sedimentary records of the Permian–Triassic transition from Meishan section, South China: Ecologically assessing mass extinction and its aftermath
- Linguistic Complexity and Socio-cultural Patterns in Hip-Hop Lyrics
- The network structure of economic output
- Oligotyping: differentiating between closely related microbial taxa using 16S rRNA gene data
- Patterns of variation in dietary composition among four populations of Alpine salamanders (Salamandra atra prenjensis)
- A Graph Signal Processing Perspective on Numerical Sequence Representations in LLM In-Context Learning
- Species‐level predation network uncovers high prey specificity in a Neotropical army ant community
- A remarkable legion of guests: Diversity and host specificity of army ant symbionts
- Comparing the impact of subfields in scientific journals
- Temporal Patterns of Happiness and Information in a Global Social Network: Hedonometrics and Twitter
- Blind inverse gamma correction with maximized differential entropy
- Unknown Sparsity in Compressed Sensing: Denoising and Inference
- Patterns of authors contribution in scientific manuscripts
- Environmental impact of kelp (Saccharina latissima) aquaculture
- Diversity in biology: definitions, quantification and models
- On Location Relevance and Diversity in Human Mobility Data
- Phylogenetic diversity measures based on Hill numbers. [europepmc]
- Old and new challenges in using species diversity for assessing biodiversity. [europepmc]
- Composition of Bacterial Communities Associated with Aurelia aurita Changes with Compartment, Life Stage, and Population. [europepmc]
- A bioinformatic framework for immune repertoire diversity profiling enables detection of immunological status. [europepmc]
- The analysis of clonal expansions in normal and autoimmune B cell repertoires. [europepmc]
- Evaluating a multigene environmental DNA approach for biodiversity assessment. [europepmc]
- Measure transcript integrity using RNA-seq data. [europepmc]
- Estimating and comparing microbial diversity in the presence of sequencing errors. [europepmc]
- Increasing neonicotinoid use and the declining butterfly fauna of lowland California. [europepmc]
- Rhea: a transparent and modular R pipeline for microbial profiling based on 16S rRNA gene amplicons. [europepmc]
- Exploring the floristic diversity of tropical Africa. [europepmc]
- Host Ecology Rather Than Host Phylogeny Drives Amphibian Skin Microbial Community Structure in the Biodiversity Hotspot of Madagascar. [europepmc]
- Biogeographical Differences in the Influence of Maternal Microbial Sources on the Early Successional Development of the Bovine Neonatal Gastrointestinal tract. [europepmc]
- Computational Strategies for Dissecting the High-Dimensional Complexity of Adaptive Immune Repertoires. [europepmc]
- On the Use of Diversity Measures in Longitudinal Sequencing Studies of Microbial Communities. [europepmc]
- K-Selection as Microbial Community Management Strategy: A Method for Improved Viability of Larvae in Aquaculture. [europepmc]
- Soil carbon sequestration accelerated by restoration of grassland biodiversity. [europepmc]
- Distinct evolutionary dynamics of horizontal gene transfer in drug resistant and virulent clones of Klebsiella pneumoniae. [europepmc]
- Global agricultural productivity is threatened by increasing pollinator dependence without a parallel increase in crop diversification. [europepmc]
- Microdiversity ensures the maintenance of functional microbial communities under changing environmental conditions. [europepmc]
- Comparison of the performance of ITS1 and ITS2 as barcodes in amplicon-based sequencing of bioaerosols. [europepmc]
- Locally adapted gut microbiomes mediate host stress tolerance. [europepmc]
- Influenza A virus undergoes compartmentalized replication in vivo dominated by stochastic bottlenecks. [europepmc]
- Gut microbiome dysbiosis in Alzheimer's disease and mild cognitive impairment: A systematic review and meta-analysis. [europepmc]
- Disproportionate declines of formerly abundant species underlie insect loss. [europepmc]
Related