BLOG

Behind the numbers.

Code examples, market analysis, and data quality deep-dives.

Which S&P 500 Companies Are Closest to Default? Merton Distance-to-Default in Python
What Happens to Stocks Removed From the S&P 500? Replacement Pair Analysis in Python
Does the Golden Cross Work? 50/200 Moving Average Crossover Backtest in Python
Financial Data for Academic Finance Research
Does Skipping the Most Recent Month Improve Momentum? S&P 500 Decile Sorts in Python
Does Cointegration Survive Out of Sample? Pairs Trading Validation in Python
Which Dividends Are Not Covered by Cash? Free-Cash-Flow Coverage Screening in Python
GICS vs SIC vs NAICS: Which Industry Classification to Use
How Many Stocks Does It Take to Diversify? Random Portfolio Simulation in Python
How Many Days of Data Does a Volatility Estimate Need? Range-Based Estimators in Python
How Much of S&P 500 Cash Flow Is Stock Compensation? Cross-Sectional Analysis in Python
What Is a 13F Filing? Institutional Holdings Explained
Does Revenue Growth Explain Profit Growth? Cross-Sectional Decomposition in Python
How Much of the Nasdaq 100 Is Already in the S&P 500? Index Overlap Analysis in Python
How Often Does a 99% Value-at-Risk Limit Actually Break? VaR Backtesting in Python
Real-Time vs End-of-Day Market Data: Which Do You Need?
How Concentrated Are S&P 500 Earnings? Point-in-Time Index Analysis in Python
Does Volatility Scale With the Square Root of Time? Variance Ratio Test in Python
Does Goodwill Distort the Price-to-Book Screen? Goodwill-Adjusted Valuation in Python
How Are Shares Outstanding Reported (and Why They Disagree)
Do Low-Volatility Stocks Deliver Better Risk-Adjusted Returns? S&P 500 Quintile Sorts in Python
Does Trend Following Beat Buy and Hold? Time-Series Momentum in Python
Has the Stock-Bond Correlation Flipped? 60/40 Portfolio Risk in Python
What API to Use for a Stock Screener
Which Assets Hedge Inflation Shocks? Macro Factor Betas in Python
Does Covariance Shrinkage Beat the Sample Covariance? Minimum-Variance Portfolios in Python
Do Faster Inventory Turns Mean Thinner Margins? Gross Margin Return on Inventory in Python
SEC EDGAR API vs Fundamentals API: Which to Use
Does Fast Earnings Growth Persist? Rank Correlation Analysis in Python
Split Adjustment Explained: Adjusted Close vs Close
Which Trading Day of the Month Pays Best? Turn-of-the-Month Analysis in Python
Can You Use Yahoo Finance Data Commercially?
How Many Independent Bets Does a Nine-Sector Portfolio Give You? Eigenvalue Analysis in Python
Which Volatility Forecast Wins One Month Ahead? HAR vs EWMA in Python
How Concentrated Are Institutional Equity Portfolios? Form 13F Concentration Analysis in Python
Do Stocks Earn Their Returns Overnight or Intraday? Return Decomposition in Python
When Do Corporate Insiders Actually Trade? Form 4 Timing Analysis in Python
Data Requirements for Backtesting a Trading Strategy
What Is Survivorship Bias in Backtesting?
Do High Dividend Yields Come From Bigger Payouts or Falling Prices? Yield Decomposition in Python
Do Stocks Fall Harder Than They Rise? Downside Beta vs Upside Beta in Python
Does Volatility Targeting Improve Sharpe Ratios? Seven-Asset Backtest in Python
Free Stock Market Data APIs: What You Actually Get
How to Give an LLM Financial Data With an MCP Server
Does Post-Earnings Announcement Drift Survive Real Filing Dates? PEAD Event Study in Python
Do Insider Buying Clusters Predict Returns? Signal Testing in Python
Does the S&P 500 Index Effect Still Exist? Event Study in Python
Are Companies Leaving the S&P 500 Faster Than They Used To? Index Survival Analysis in Python
Does Gross Profitability Predict Stock Returns? Quintile Factor Test in Python
What Growth Rate Is the Market Pricing In? Reverse DCF in Python
Does a Strong Balance Sheet Cushion Drawdowns? Leverage and Downside Risk in Python
Does Ticker Recycling Corrupt a Mean-Reversion Backtest? Entity-Resolved Z-Scores in Python
How Much of a Growth Screen's Backtested Edge Is Survivorship Bias? Point-in-Time Index Testing in Python
Why Do Leveraged ETFs Decay? Measuring Volatility Drag in Python
Are Consumer Staples Margins Shrinking Under Inflation? Gross Margin Trend Analysis in Python
Do Weak Jobs Reports Predict Market Drawdowns? NFP Surprise Event Study in Python
Is the Rotation From Tech to Industrials Backed by Earnings? Relative EPS Growth Analysis in Python
Is the Semiconductor Rally Broadening Beyond NVIDIA? Return Dispersion Analysis in Python
Which Stocks Benefit Most When Oil Prices Fall? Oil Beta Screening in Python
Do Bond Returns Predict Stock Returns? Granger Causality Test in Python
Which Stocks Actually Drive Portfolio Returns? Shapley Value Attribution in Python
Does "Sell in May" Still Work? Calendar Anomaly Backtest in Python
How to Build Complete Price History Through Ticker Changes? Entity Resolution in Python
Are KO and PEP Cointegrated? Pairs Trading Signal Construction in Python
Which Commodities Have the Strongest Momentum? Rotation Backtest in Python
Which Commodity ETFs Have the Worst Tail Risk? Expected Shortfall in Python
Are Gold Miners Leveraged Gold Bets? Rolling Beta Analysis in Python
Does the Base-Metals-to-Gold Ratio Lead Cyclical Stocks? Signal Test in Python
Can Risk Parity Tame Commodity Volatility? Portfolio Optimization in Python
Are Power Stocks Becoming an AI Infrastructure Trade? Momentum Screening in Python
Which AI Chip Stocks Have Margin Momentum? Profitability Trend Analysis in Python
Which AI Stocks Are Cheapest Relative to Growth? Growth-Adjusted Valuation in Python
Does AI Stock Leadership Persist? Momentum Backtest in Python
Which AI Stocks Have the Cleanest Balance Sheets? Net Cash Screening in Python
Can Risk Parity Reduce Mega-Cap Drawdowns? Portfolio Optimization in Python
Which Growth Stocks Are Self-Funding? Cash-Flow Quality Screening in Python
Which Sectors Struggle When the Dollar Rallies? Sector Rotation Analysis in Python
Do Cheap Stocks Hold Up When Bonds Sell Off? Valuation Rotation in Python
Does the Nasdaq 100 Have Better Growth Quality Than the Dow? Index Constituent Analysis in Python
Do Healthcare Cash-Flow Margins Predict Returns? Signal Evaluation in Python
Which Dividend Stocks Survive a Cash-Flow Stress Test? Dividend Screening in Python
Does Heavy Insider Selling Predict Weak Returns? Insider Flow Test in Python
Can Quality Screens Reduce Small-Cap Balance-Sheet Risk? Russell 2000 Test in Python
Which Retailers Have Positive Operating Leverage? Margin Screening in Python
Is MSTR a Leveraged Bitcoin Proxy? Rolling Beta Analysis in Python
Is Micron's Memory Cycle Recovering? Inventory and Margin Forecasting in Python
Which Sectors Work When Bonds Rally? Rate-Sensitive Rotation in Python
Do One-Month Price Extremes Reverse? Signal Evaluation in Python
Do Low-Volatility S&P 500 Stocks Reduce Drawdowns? Factor Test in Python
Is AI Capex Paying Back Fast Enough? Revenue Hurdle Forecasting in Python
Could Shorter AI Asset Lives Hit Earnings? Depreciation Stress Test in Python
How Much AI Capex Risk Can a Portfolio Remove? Constrained Optimization in Python
Is the AI Capex Trade Crowded? Rolling Volatility and Sector Rotation in Python
Did the AI Boom Come From Existing S&P 500 Members? Point-in-Time Momentum Test in Python
Is AI Revenue Circular? Customer-Vendor Capex Loop Analysis in Python
Is the AI Trade Connected to Private Credit? Rolling Correlation Network in Python
Is Apollo More Balance-Sheet Sensitive Than Peers? Leverage Screen in Python
Are AI Earnings Supported by Cash Flow? Accrual and Capex Screen in Python
Can Defensive Stocks Hedge AI Drawdowns? Basket Regime Test in Python
How Fast Does the Market Price In Fed Decisions? FOMC Event Study in Python
How Much Are Options Sellers Overpaid? The Variance Risk Premium in Python
Which Companies Have the Worst Earnings Quality? Sloan Accrual Screen with Geographic Revenue Data in Python
Does the Oil-to-Gold Ratio Signal Recessions? XLE/GLD Backtest in Python
Is AI Spending Crowding Out Free Cash Flow? Capex Sustainability Across the Mag 7 in Python
Does a Long Energy / Short Bonds Portfolio Capture Inflation Surprises? Factor Construction in Python
Can a Hidden Markov Model Detect Oil Market Regimes? HMM Analysis in Python
Do Grain Prices Predict Food Inflation? Granger Causality Test in Python
Does the Corporate Credit Spread Predict Stock Market Crashes? BAA-AAA Spread Analysis in Python
Do Oil Stocks Hedge Inflation? Rolling Beta Analysis in Python
Which Stocks Are Most Rate-Sensitive? Equity Duration via Bond Beta in Python
Which Companies Have the Highest Accrual Ratios? Earnings Quality Screening in Python
Is Alpha Persistent or Decaying? Rolling Sharpe Ratio Analysis in Python
Are Markets Trending or Mean-Reverting? Hurst Exponent Analysis in Python
Is Consumer Discretionary vs Staples a Leading Indicator? XLY/XLP Ratio Analysis in Python
Does Heavy Capex Predict Future Stock Returns? Capital Expenditure Analysis in Python
How to Estimate Cost of Equity Using CAPM in Python
Is Volatility Predictable? Testing for Volatility Clustering in Python
Which Industrials Are Overleveraged? Net Debt to EBITDA Screening in Python
GM Before and After Bankruptcy: Why Entity Resolution Matters for Financial Data
What Is Adjusted Beta? Merrill Lynch Beta Shrinkage in Python
How Good Is a Stock Pick? Information Ratio and Tracking Error in Python
Do Stock Returns Follow a Normal Distribution? Testing for Fat Tails in Python
Which Large Caps Have the Highest Free Cash Flow Yield? FCF Screening in Python
Which Sectors Won Over 5 Years? Sector Rotation Analysis in Python
How to Forecast Stock Volatility with GARCH Models in Python
Are Stock Prices Mean-Reverting? Augmented Dickey-Fuller Test in Python
How to Calculate CAPM Alpha and Beta with Regression in Python
How to Compare Sector Sharpe Ratios and Sortino Ratios in Python
DELL: Why Stitching Historical Price Data Together Is Wrong
How to Analyze Drawdown and Recovery for Bank Stocks in Python
How to Screen SaaS Stocks by Revenue Growth and Cash Flow in Python
How to Screen REITs by Dividend Yield and Valuation in Python
How Correlated Are the Magnificent 7? Intra-Group Correlation in Python
AAPL vs XOM: Do Individual Stocks Have Seasonal Patterns?
How to Rank Large-Cap Stocks by Momentum in Python
How to Build a Multi-Endpoint Financial Dashboard in Python
How to Compare Volatility Across Energy Stocks in Python
How to Screen Healthcare Stocks by Valuation in Python
How to Build a Sector Correlation Matrix for Portfolio Diversification in Python
How to Find Oversold and Overbought Stocks Using Z-Scores in Python
How to Measure Earnings Quality: Cash Flow vs Net Income in Python
How to Build a Multi-Factor Stock Screen in Python (Value + Momentum + Quality)
How to Build a Simple DCF Model for Any Stock in Python
How to Screen Tech Stocks by Revenue Growth in Python
How to Screen Stocks by Balance Sheet Health in Python
Is "Sell in May" Real? SPY Monthly Seasonality Over 10 Years
How to Compare Sector Performance YTD Using Python
How to Screen Dividend Stocks by Yield and Quality in Python
How to Calculate Max Drawdown and Recovery Time for Any Stock in Python
How to Compare Profitability Across Mega-Cap Tech Stocks in Python
Why Ticker Symbols Are Unreliable: The Recycling Problem Every Quant Should Know
How to Calculate and Compare Stock Volatility in Python
How to Screen Blue-Chip Stocks by P/E Ratio in Python
How to Track Companies Through Ticker Changes, Bankruptcies, and Renames in Python
S&P 500 Turnover: How Much the Index Has Changed Since 2010
How to Calculate Stock Beta and Correlation in Python
← All articles

Financial Data for Academic Finance Research

Academic work sets a higher bar on data than most trading work does, and reproducibility is the reason. A referee has to be able to check the result, and a co-author has to be able to rerun the same code eighteen months later and land on the same table. Public sources cover a large part of what a paper needs at no cost: SEC EDGAR carries the filings and the XBRL facts inside them, the Kenneth French Data Library carries factor and portfolio returns, and FRED carries the macro series. What none of them carries is the piece most empirical equity papers turn on, which is a cross-section of companies as it stood on a past date, with a stable identifier per company across ticker changes, reconstructable months later without argument.

What does a referee actually check?

Data objections in empirical finance cluster into four shapes, and they are worth knowing before the first regression rather than after the first rejection.

  1. Universe as of the date, not as of today. A sample drawn from the current index membership and run backwards has already excluded every company that failed, merged, or was demoted, so the estimate that comes out is not the estimate the strategy would have produced. The survivorship bias guide works through how large the distortion gets.
  2. Adjustment convention stated explicitly. Split adjustment, dividend treatment, and whether a return series is total or price-only change the answer materially, and a paper that does not say which convention it used cannot be replicated even by its own authors.
  3. Identifier continuity. Tickers are reassigned. A panel keyed on the ticker string silently splices one company’s history onto another’s, and the join looks perfectly healthy while it does so.
  4. A licence that permits the replication package. Journals increasingly ask for code and data alongside the manuscript, and a source whose terms forbid redistribution makes that package impossible to supply.

Which free sources are research-grade?

Several public sources are good enough to build a published paper on, and it is worth being precise about what each one gives.

The SEC EDGAR APIs are the strongest free source for anything filing-level. The SEC’s own developer page, read on 6 August 2026, states that “these APIs do not require any authentication or API keys to access”, and that “currently included in the APIs are the submissions history by filer and the XBRL data from financial statements”. Latency is not the constraint: the same page states that “the submissions API is updated with a typical processing delay of less than a second; the xbrl APIs are updated with a typical processing delay of under a minute”. The cost of EDGAR is engineering, not money, and the EDGAR API versus fundamentals API comparison sets out what that engineering involves.

The Kenneth French Data Library at Dartmouth is the default source for factor returns and is free to download. Read on 6 August 2026, it publishes the Fama/French three- and five-factor series at monthly, weekly and daily frequency, momentum and reversal factors, portfolio sorts on size, book-to-market, operating profitability and investment, industry portfolios at 5 through 49 groupings, and developed and emerging market factors by region, under the notice “Copyright Eugene F. Fama and Kenneth R. French”. For a paper that needs benchmark factor returns rather than its own construction of them, there is no reason to rebuild what this library already publishes.

FRED covers the macro side and requires registration. Its terms of use, read on 6 August 2026, require applications to display the notice “this product uses the FRED® API but is not endorsed or certified by the Federal Reserve Bank of St. Louis”, and place responsibility on the user for third-party content: users are “solely responsible for complying with any requirements or restrictions imposed on usage of the data series by their respective owners”. Copyrighted series inside FRED are not automatically yours to republish.

Alpha Vantage offers a free key with, in its own words on its premium page as of 6 August 2026, “the standard API usage limit (25 API requests per day)”. Premium tiers on the same page start at “75 requests/min + premium support: $49.99/month”. Twenty-five calls a day is a tutorial budget, not a panel budget.

Source Covers Access Practical limit for a paper
SEC EDGAR APIs Filings, submissions history, XBRL facts No key, no authentication Parsing and normalisation are yours to build
Kenneth French Data Library Factor returns, portfolio sorts, industry portfolios Free download Portfolio-level only, no company panel
FRED Macro and rate series Free, key required, attribution notice required Series-owner restrictions pass through to you
Alpha Vantage Prices and company data Free key, 25 requests per day Paid tiers begin at $49.99 per month

Can a paper be built on scraped market data?

Read the terms before the sample is built, because the answer for the most commonly scraped source is unambiguous. Yahoo’s terms of service, read on 6 August 2026, prohibit users from “access or collect data, or attempt to access or collect data, from our Services using any automated means, devices, programs, algorithms or methodologies, including but not limited to robots, spiders, scrapers, data mining tools, or data gathering or extraction tools, for any purpose without our express, prior permission”. They also state that “unless otherwise expressly stated, you may not access or reuse the Services, or any portion thereof, for any commercial purpose”, and separately forbid using the material “to create any database, archive, mobile application, data feed, widget or any other aggregated data source that competes with or constitutes a material substitute for the Services”.

Whether a funded research project counts as commercial is a question for a university’s counsel. The replication-package question is simpler: a dataset assembled by automated collection against those terms cannot be redistributed alongside the manuscript. The commercial-use guide goes through the terms clause by clause.

Where the free stack runs out

The gap is the company panel. EDGAR tells you what a company filed but not which companies were in an index on a given date; the French library gives portfolio returns but not the companies inside them; FRED is macro. Building a point-in-time universe from public sources means reconstructing index membership from historical announcements, then keeping identifiers stable through every rename, merger and delisting in the sample window. That reconstruction is the part of a methods section reviewers probe hardest.

The size of the problem is easy to measure. Pulling the S&P 500 as it stood at the end of 2005 returns 500 companies; the current roster returns 504; fewer than half of the 2005 names are in the index today. A study that starts from today’s 504 and runs back twenty years is studying the survivors.

What a workable research stack looks like

Factor returns from the French library, macro series from FRED, and filings from EDGAR when the unit of analysis is the filing itself. For the company panel, xfinlink returns index membership as of any past date, so the universe is a parameter rather than a project:

import xfinlink as xfl

xfl.set_api_key("YOUR_API_KEY")  # free at https://xfinlink.com/signup

roster_2005 = xfl.index("sp500", as_of="2005-12-30")
current = xfl.index("sp500")

print(len(roster_2005), len(current))
500 504

Entities carry a permanent identifier alongside the ticker, which is what keeps a panel intact when a company changes symbol, and the data endpoints accept that identifier directly, so a company that no longer holds its old ticker is still reachable. Financial statement data is built from SEC EDGAR public filings, with a source column on each row recording provenance. A free key runs one ticker per request with a twelve-month history window and 100 requests a day, enough to test whether the data fits the design before any money is spent; paid plans open the full history, with daily prices back to 1996 and financial statements back to 1950. The docs list the fields each endpoint returns and the pricing page sets out the plan limits.

FAQ

Is SEC EDGAR enough on its own for an equity paper?
For anything filing-level, yes. For a cross-sectional panel, no, because EDGAR has no concept of index membership and no answer to which companies existed and traded on a given past date.

Which factor returns should a paper use?
The Fama/French series from the Kenneth French Data Library, unless the contribution of the paper is a new factor construction. They are free, they are the series referees expect, and rebuilding them introduces differences that then have to be explained.

What breaks a replication most often?
Universe construction. Two researchers using the same method on the same period will disagree if one drew the sample from today’s index membership and the other reconstructed it as of the sample dates, and nothing in either codebase will report an error.

Built with xfinlink — free financial data API for Python. pip install -U xfinlink

Built with xfinlink — free financial data API for Python. pip install -U xfinlink
← All articles