The best way to revise the sentence using a dash is:
I am learning about Japan—believe it or not, it is a chain of around 4,000 islands.
This version properly uses the dash to set off the phrase "believe it or not," providing a clear and effective pause in the sentence.