c++ - Utf-8 to URI percent encoding -


i'm trying convert unicode code points percent encoded utf-8 code units.

the unicode -> utf-8 conversion seems working correctly shown testing hindi , chinese characters show correctly in notepad++ utf-8 encoding, , can translated properly.

i thought percent encoding simple adding '%' in front of each utf-8 code unit, doesn't quite work. rather expected %e5%84%a3, i'm seeing %xe5%x84%xa3 (for unicode u+5123).

enter image description here

what doing wrong?

added code (note utf8.h belongs utf8-cpp library). 

#include <fstream> #include <iostream> #include <vector> #include "utf8.h"  std::string unicode_to_utf8_units(int32_t unicode) {     unsigned char u[5] = {0,0,0,0,0};     unsigned char *iter = u, *limit = utf8::append(unicode, u);     std::string s;     (; iter != limit; ++iter) {         s.push_back(*iter);     }     return s; }  int main() {     std::ofstream ofs("test.txt", std::ios_base::out);     if (!ofs.good()) {         std::cout << "ofstream encountered problem." << std::endl;         return 1;     }      utf8::uint32_t unicode = 0x5123;     auto s = unicode_to_utf8_units(unicode);     (auto &c : s) {         ofs << "%" << c;     }      ofs.close();      return 0; }

you need convert byte values corresponding ascii strings, example:

"é" in utf-8 value { 0xc3, 0xa9 }. please not these bytes, char values in c++.

each byte needs converted to: "%c3" , "%c9" respectively.

the best way use sstream:

std::ostringstream out; std::string utf8str = "\xe5\x84\xa3";  (int = 0; < utf8str.length(); ++i) {     out << '%' << std::hex << std::uppercase << (int)(unsigned char)utf8str[i]; }

or in c++11:

for (auto c: utf8str) {     out << '%' << std::hex << std::uppercase << (int)(unsigned char)c; }

please note bytes need cast int, because else << operator use litteral binary value. first casting unsigned char needed because otherwise, sign bit propagate int value, causing output of negative values ffffffe5.


Comments

Post a Comment

Popular posts from this blog

php - Add the correct number of days for each month -

using following function can display years , months between 2 dates, how can add correct days each month array within each month? can't add days manually need account leap years etc. function yearmonth($start_date, $end_date) { $begin = new datetime( $start_date ); $end = new datetime( $end_date); $interval = new dateinterval('p1m'); // 1 month interval $period = new dateperiod($begin, $interval, $end); foreach ( $period $dt ) $years[$dt->format( "y" )][] = $dt->format( "f" ); return $years; } $list = yearmonth("2007-03-24", "2009-06-26"); var_dump($list); since nobody else answered: function yearmonth($start_date, $end_date) { $begin = new datetime( $start_date ); $end = new datetime( $end_date); $interval = new dateinterval('p1d'); // 1 month interval $period = new dateperiod($begin, $interval, $end); $lastmonth = null; $lastyear = null; $aresult = array(); forea...
Read more

java.util.scanner - How to read and add only numbers to array from a text file -

i'm learning java , have question regarding reading file want read numbers file contains strings well. here example of file: 66.56 "3 java 3-43 5-42 2.1 1 and here coding: public class test { public static void main (string [] args){ if (0 < args.length) { file x = new file(args[0]); try{ scanner in = new scanner( new fileinputstream(x)); arraylist<double> test = new arraylist<>(); while(in.hasnext()){ if(in.hasnextdouble()){ double f=in.nextdouble(); test.add(f);} else {in.next();} } catch(ioexception e) { system.err.println("exception during reading: " + e); } } my problem add 66.56,2.1 , 1 doesn't add 3 after "3 or ignores 3-43 , 5-42 can tell me how skip strings , add doubles here? thanks all said 3 ie; "3, 3-43 , 4-42 strings either u read string , split , check number @ " , - or put in space between characters , integers. jvm after compilation tre...
Read more