std::codecvt_utf8
From cppreference.com
                    
                                        
                    
                    
                                                            
                    |   Defined in header  
<codecvt>
  | 
||
|   template<  
    class Elem,  | 
||
std::codecvt_utf8 is a std::codecvt facet which encapsulates conversion between a UTF-8 encoded byte string and UCS2 or UCS4 character string (depending on the type of Elem). This codecvt facet can be used to read and write UTF-8 files, both text and binary. 
Contents | 
[edit] Template Parameters
| Elem | - | either char16_t, char32_t, or wchar_t | 
| Maxcode | - |   the largest value of Elem that this facet will read or write without error
 | 
| Mode | - | a constant of type std::codecvt_mode | 
[edit] Member functions
|     (constructor)  | 
  constructs a new codecvt_utf8 facet (public member function)  | 
|     (destructor)  | 
  destroys a codecvt_utf8 facet (public member function)  | 
std::codecvt_utf8::codecvt_utf8
|   explicit codecvt_utf8( std::size_t refs = 0 ); 
 | 
||
Constructs a new std::codecvt_utf8 facet, passes the initial reference counter refs to the base class.
Parameters
| refs | - | the number of references that link to the facet | 
std::codecvt_utf8::~codecvt_utf8
|   ~codecvt_utf8(); 
 | 
||
Destroys the facet. Unlike the locale-managed facets, this facet's destructor is public.
Inherited from std::codecvt
Member types
| Member type | Definition | 
  intern_type
 | 
  internT
 | 
  extern_type
 | 
  externT
 | 
  state_type
 | 
  stateT
 | 
Member objects
| Member name | Type | 
  id (static)
 | 
std::locale::id | 
Member functions
   invokes do_out  (public member function of std::codecvt) 
 | 
|
   invokes do_in  (public member function of std::codecvt) 
 | 
|
   invokes do_unshift  (public member function of std::codecvt) 
 | 
|
   invokes do_encoding  (public member function of std::codecvt) 
 | 
|
   invokes do_always_noconv  (public member function of std::codecvt) 
 | 
|
   invokes do_length  (public member function of std::codecvt) 
 | 
|
   invokes do_max_length  (public member function of std::codecvt) 
 | 
Protected member functions
|    [virtual] 
 | 
   converts a string from internT to externT, such as when writing to file  (virtual protected member function of std::codecvt) 
 | 
|    [virtual] 
 | 
   converts a string from externT to internT, such as when reading from file  (virtual protected member function of std::codecvt) 
 | 
|    [virtual] 
 | 
   generates the termination character sequence of externT characters for incomplete conversion  (virtual protected member function of std::codecvt) 
 | 
|    [virtual] 
 | 
   returns the number of externT characters necessary to produce one internT character, if constant  (virtual protected member function of std::codecvt) 
 | 
|    [virtual] 
 | 
  tests if the facet encodes an identity conversion for all valid argument values   (virtual protected member function of std::codecvt) 
 | 
|    [virtual] 
 | 
  calculates the length of the externT string that would be consumed by conversion into given internT buffer  (virtual protected member function of std::codecvt) 
 | 
|    [virtual] 
 | 
   returns the maximum number of externT characters that could be converted into a single internT character  (virtual protected member function of std::codecvt) 
 | 
Inherited from std::codecvt_base
| Member type | Definition | 
| enum result { ok, partial, error, noconv }; | Unscoped enumeration type | 
| Enumeration constant | Definition | 
  ok
 | 
conversion was completed with no error | 
  partial
 | 
not all source characters were converted | 
  error
 | 
encountered an invalid character | 
  noconv
 | 
no conversion required, input and output types are the same | 
[edit] Example
The following example demonstrates the difference between UCS2/UTF-8 and UTF-16/UTF-8 conversions: the third character in the string is not a valid UCS2 character.
Run this code
#include <iostream> #include <string> #include <locale> #include <codecvt> int main() { // UTF-8 data. The character U+1d10b, musical sign segno, does not fit in UCS2 std::string utf8 = u8"z\u6c34\U0001d10b"; // the UTF-8 / UTF-16 standard conversion facet std::wstring_convert<std::codecvt_utf8_utf16<char16_t>, char16_t> utf16conv; std::u16string utf16 = utf16conv.from_bytes(utf8); std::cout << "UTF16 conversion produced " << utf16.size() << " code points:\n"; for (char16_t c : utf16) std::cout << std::hex << std::showbase << c << '\n'; // the UTF-8 / UCS2 standard conversion facet std::wstring_convert<std::codecvt_utf8<char16_t>, char16_t> ucs2conv; try { std::u16string ucs2 = ucs2conv.from_bytes(utf8); } catch(const std::range_error& e) { std::u16string ucs2 = ucs2conv.from_bytes(utf8.substr(0, ucs2conv.converted())); std::cout << "UCS2 failed after producing " << std::dec << ucs2.size()<<" characters:\n"; for (char16_t c : ucs2) std::cout << std::hex << std::showbase << c << '\n'; } }
Output:
UTF16 conversion produced 4 code points: 0x7a 0x6c34 0xd834 0xdd0b UCS2 failed after producing 2 characters: 0x7a 0x6c34
[edit] See also
|  Character conversions  | 
 narrow multibyte (char)  | 
 UTF-8 (char)  | 
 UTF-16 (char16_t)  | 
|---|---|---|---|
| UTF-16 | mbrtoc16 / c16rtomb | 
codecvt<char16_t, char, mbstate_t> codecvt_utf8_utf16<char16_t> codecvt_utf8_utf16<char32_t> codecvt_utf8_utf16<wchar_t>  | 
N/A | 
| UCS2 | No | codecvt_utf8<char16_t> | codecvt_utf16<char16_t> | 
|  UTF-32/UCS4 (char32_t)  | 
mbrtoc32 / c32rtomb | 
codecvt<char32_t, char, mbstate_t> codecvt_utf8<char32_t>  | 
codecvt_utf16<char32_t> | 
|  UCS2/UCS4 (wchar_t)  | 
No | codecvt_utf8<wchar_t> | codecvt_utf16<wchar_t> | 
|  wide (wchar_t)  | 
codecvt<wchar_t, char, mbstate_t> mbsrtowcs / wcsrtombs  | 
No | No | 
|    converts between character encodings, including UTF-8, UTF-16, UTF-32  (class template)  | 
|
|    (C++11) 
 | 
   tags to alter behavior of the standard codecvt facets  (enum)  | 
|    (C++11) 
 | 
   converts between UTF-16 and UCS2/UCS4   (class template)  | 
|    (C++11) 
 | 
   converts between UTF-8 and UTF-16   (class template)  |