Japanese characters transcoding: stop using Shift-JIS for the source
10+ years most with Ruby on Rails and JavaScript frontend and some Go. My first language is C for 3 years in university.
Search for a command to run...
10+ years most with Ruby on Rails and JavaScript frontend and some Go. My first language is C for 3 years in university.
No comments yet. Be the first to comment.
I recently updated from Slim template to ERB to use Herb (Thanks Marco). I had to update a test that was very strict on the format. I realized that Capybara::Node::Simple doesn’t provide a selector for regex. The page object doesn’t have a match? met...

It is as simple as: rustup completions zsh > ~/.zfunc/_rustup rustup completions zsh cargo > ~/.zfunc/_cargo With a TAB you get the auto-complete or the options available: ❯ cargo b b -- alias: build bench -- Execute all benchmarks of a local ...
Let’s not re-write a good article, go to: https://joyofrails.com/articles/mastering-custom-configuration-in-rails I mostly used config.x configuration that loads a yaml file with config_for that do the multi-environment by default: module YourApp c...
No need to re-write the wheel, let me redirect to this great article from Lily Reile. Obviously still up-to-date and really useful as the official Rails doc is mostly showing the value before and after. https://lilyreile.medium.com/rails-6-1-new-fram...
I came around to update Appsignal gem to the new major version of Appsignal released at the end of August 2024: https://rubygems.org/gems/appsignal/versions/4.0.0 The upgrade was smooth. The real change for my application was to remove the parameter ...
So, last day I got an encoding error. The data is what I though was in Shift-JIS but it could not be converted to UTF-8 because in Shift-JIS ‡ U+0087 does not exists.

It's is multiple used as title like so:

https://www.htmlsymbols.xyz/unicode/U+0087
In Windows, apparently, instead of the strict Shift-JIS, they are using CP932 which is superset of Shift-JIS (meaning it's Shift-JIS with additional characters).
CP932 encoding when dealing with Japanese characters.The Rubyist out there, it will be:
CSV.read("csvfile.csv", encoding: "CP932:UTF-8")