chardet

Character encoding detector

MIT 30 个版本
encoding character utf8 detector chardet icu character detection character encoding language iconv iconv-light UTF-8 UTF-16 UTF-32 ISO-2022-JP ISO-2022-KR ISO-2022-CN Shift_JIS Big5 EUC-JP EUC-KR GB18030 ISO-8859-1 ISO-8859-2 ISO-8859-5 ISO-8859-6 ISO-8859-7 ISO-8859-8 ISO-8859-9 windows-1250 windows-1251 windows-1252 windows-1253 windows-1254 windows-1255 windows-1256 windows-1257 windows-1258 windows-874 TIS-620 KOI8-R
主页
仓库
提交 Issue
安装
npm install chardet
yarn add chardet
pnpm add chardet
bun add chardet
README

chardet

Chardet is a character detection module written in pure JavaScript (TypeScript). Module uses occurrence analysis to determine the most probable encoding.

  • Packed size is only 22 KB
  • Works in all environments: Node / Browser / Native
  • Works on all platforms: Linux / Mac / Windows
  • No dependencies
  • No native code / bindings
  • 100% written in TypeScript
  • Extensive code coverage

Installation

npm i chardet

Usage

To return the encoding with the highest confidence:

import chardet from 'chardet';

const encoding = chardet.detect(Buffer.from('hello there!'));
// or
const encoding = await chardet.detectFile('/path/to/file');
// or
const encoding = chardet.detectFileSync('/path/to/file');

To return the full list of possible encodings use analyse method.

import chardet from 'chardet';
chardet.analyse(Buffer.from('hello there!'));

Returned value is an array of objects sorted by confidence value in descending order

[
  { confidence: 90, name: 'UTF-8' },
  { confidence: 20, name: 'windows-1252', lang: 'fr' },
];

In browser, you can use Uint8Array instead of the Buffer:

import chardet from 'chardet';
chardet.analyse(new Uint8Array([0x68, 0x65, 0x6c, 0x6c, 0x6f]));

Working with large data sets

Sometimes, when data set is huge and you want to optimize performance (with a trade off of less accuracy), you can sample only the first N bytes of the buffer:

const encoding = await chardet.detectFile('/path/to/file', { sampleSize: 32 });

You can also specify where to begin reading from in the buffer:

const encoding = await chardet.detectFile('/path/to/file', {
  sampleSize: 32,
  offset: 128,
});

Working with strings

In both Node.js and browsers, all strings in memory are represented in UTF-16 encoding. This is a fundamental aspect of the JavaScript language specification. Therefore, you cannot use plain strings directly as input for chardet.analyse() or chardet.detect(). Instead, you need the original string data in the form of a Buffer or Uint8Array.

In other words, if you receive a piece of data over the network and want to detect its encoding, use the original data payload, not its string representation. By the time you convert data to a string, it will be in UTF-16 encoding.

Note on TextEncoder: By default, it returns a UTF-8 encoded buffer, which means the buffer will not be in the original encoding of the string.

Supported Encodings:

  • UTF-8
  • UTF-16 LE
  • UTF-16 BE
  • UTF-32 LE
  • UTF-32 BE
  • ISO-2022-JP
  • ISO-2022-KR
  • ISO-2022-CN
  • Shift_JIS
  • Big5
  • EUC-JP
  • EUC-KR
  • GB18030
  • ISO-8859-1
  • ISO-8859-2
  • ISO-8859-5
  • ISO-8859-6
  • ISO-8859-7
  • ISO-8859-8
  • ISO-8859-9
  • windows-1250
  • windows-1251
  • windows-1252
  • windows-1253
  • windows-1254
  • windows-1255
  • windows-1256
  • windows-1257
  • windows-1258
  • windows-874 (TIS-620 / ISO-8859-11)
  • KOI8-R

Currently only these encodings are supported.

TypeScript?

Yes. Type definitions are included.

References

TODO

  • KOI8-U for Ukrainian
  • IBM866 for DOS Cyrillic
  • macintosh and x-mac-cyrillic
  • CP949 / UHC support within the Korean recognizer
  • ISO-8859-3, ISO-8859-4
  • ISO-8859-10, ISO-8859-13
  • ISO-8859-14, ISO-8859-15, ISO-8859-16
  • DOS CP850, CP852, CP855
版本列表
2.2.0 2026-06-20
2.1.1 2025-10-29
2.1.0 2025-02-24
2.0.0 2023-09-28
1.6.1 2023-09-28
1.6.0 2023-06-16
1.5.1 2023-01-05
1.5.0 2022-10-09
1.4.0 2021-10-19
1.3.0 2020-09-25
1.2.2 2020-09-23
1.2.1 2020-07-06
1.2.0 2020-07-02
1.1.0 2020-05-07
1.0.0 2020-03-31
0.8.0 2019-07-11
0.7.0 2018-08-17
0.6.0 2018-07-03
0.5.0 2018-04-22
0.4.2 2017-11-26
0.4.1 2017-11-26
0.4.0 2017-10-16
0.3.0 2017-10-16
0.1.0 2015-11-29
0.0.8 2013-08-16
0.0.7 2013-08-06
0.0.6 2013-05-06
0.0.5 2013-05-04
0.0.4 2013-05-01
0.0.3 2013-04-30