Unsupervised generation of tradable topic indices through textual analysis
Marcel Lee & Alan Spark
What the paper says
Stock returns are moved by many risk factors. Thematic stock indices try to represent these factors, but are limited by the fact that risk factors are not directly observable. This paper introduces a method to uncover hidden risk factors through text analysis. It applies the dynamic variant of the Latent Dirichlet Allocation (LDA) model to annual and quarterly reports to find a topic distribution for each stock. This is then interpreted as the risk factor partition and transformed into a standard normal basis which corresponds to pure risk factors. The weights indicate the proportions necessary to combine the equities into tradable topic indices. The need for human intervention is minimized by determining the optimal parameters automatically. • Creation of thematic indices based on natural language processing. • Discovery of Hidden Risk Factors. Applying Topic Modeling to portfolio construction. • Automatic choice of Topic numbers based on Topic Coherence and Perplexity • Automated monitoring of industry trends • Low cost automated alternative to established static taxonomic index construction
1 citation
Evidence weight
Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40
| F · citation impact | 0.16 × 0.4 = 0.06 |
| M · momentum | 0.53 × 0.15 = 0.08 |
| V · venue signal | 0.50 × 0.05 = 0.03 |
| R · text relevance † | 0.50 × 0.4 = 0.20 |
† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.