Search Shortcut cmd + k | ctrl + k
title_mapper

Efficiently standardizes scraped job titles to Bureau of Labor Statistics (BLS) titles using a high-performance TF-IDF algorithm.

Maintainer(s): martin-conur

Compatibility Matrix

This table covers all DuckDB releases that have not reached end-of-life, including LTS releases, and shows the 2 most recent patch releases of each. Older patch releases are not listed, but the extension may be available for them as well.

Platform 1.4.4 1.4.5 1.5.5 1.5.6 2.0.0
Linux AMD64
Linux ARM64
macOS AMD64
macOS ARM64
Windows AMD64
Windows ARM64
WebAssembly

Installing and Loading

INSTALL title_mapper FROM community;
LOAD title_mapper;

Example

-- Standardize a column
SELECT standardize_title(scraped_title_column) FROM your_table;

-- Standardize tech job titles
SELECT standardize_title('Sr. Software Eng') AS standardized_title;
-- Result: 'Software Engineer - Software Developers'

-- Standardize healthcare titles
SELECT standardize_title('RN - Emergency Room') AS standardized_title;
-- Result: 'Registered Nurse - Registered Nurses'

About title_mapper

DuckDB Title Mapper

duckdb-title-mapper is a highly optimized DuckDB extension written in Rust. It standardizes scraped job titles to BLS (Bureau of Labor Statistics) standard titles using a fast TF-IDF implementation.

What It Does

This extension transforms messy, inconsistent job titles from various sources into standardized BLS titles:

Scraped Title (Input) Standardized Title (Output)
Sr. Software Eng Software Engineer
Registered Nurse - ICU Registered Nurse
Accountant III Accountant
Sales Rep (B2B) Sales Representative
Elementary School Teacher - 3rd Grade Elementary School Teacher
Exec. Chef Executive Chef
Marketing Coordinator/Specialist Marketing Specialist
Licensed Practical Nurse (LPN) Licensed Practical Nurse

Added Functions

function_name function_type description comment examples
standardize_title scalar Returns the BLS standard title using TF-IDF NULL [SELECT standardize_title(scraped_title_column) FROM your_table;]

Overloaded Functions

This extension does not add any function overloads.

Added Types

This extension does not add any types.

Added Settings

This extension does not add any settings.