ENT surgeon who has bilateral CIs and has been in the research field for 20+ years. This sort of stuff is cool, but there are lots of limitations at the auditory nerve interface that limits improvements to speech and music processing strategies. Crazily enough, many of these studies were done in the 1960s to 1990s and are still valid today. There are strategies that can help at individual level, but do not help everyone. Thus they have not made it to clinical use.
I am deeply grateful for your words. It has been just over a year since I received my cochlear implant. Thanks to you, I learned for the first time today that this methodology is not yet mature enough to be used in clinical practice. I started this because I wanted to understand the sounds of the world I now hear, but there is still so much I don't know. That is why I am actively participating in and collaborating on cochlear implant research in Korea as much as I can. I also sincerely thank you for your dedication to advancing science.
Thanks for posting. If you have time to write some more thoughts on those limits and individual strategies I'm sure it would be interesting to many of us here.
Is there any research into other ways to 'get sound into the brain', generally speaking? If so: some pointers would be much appreciated.
After being hard-hearing since early childhood (bad living conditions -> tuberculosis -> ototoxic antibiotic, streptomycine iirc), my mum had a CI for a # of years. But due to infections, it got removed at some point. Since then I've always wondered if there's other routes to get sound into the brain. Say, using vibrations on the skin. Or an electrode-stuffed 'helmet' of sorts.
Even if temporary, it can be a life-changing experience for someone who's never experienced sound.
I have history of hearing losss and a more recent episode of bilateral SSHL post viral infection with relatively decent recovery. I am left me with deficient sloping loss in the high frequencies 50-60 db. I wonder if the day will come when I will need CI. So far I can manage but since medically no doc is able to point out the cause of the loss I’m starting to familiarize myself with them. I hope progress is being made on CI front and the regenerative one as well
> But I cannot know what sound is really like, because I have no memory of normal hearing.
and
> I was born with normal hearing. I began losing my hearing in childhood ... After I was registered, I started wearing hearing aids. People's voices became clear, and for a few months things were good. ... A specialist told me that I badly needed cochlear implant surgery, but I hesitated because it was very expensive.
I was born with normal hearing and acquired language while I still had it. But now, no matter how hard I try to think back, I can’t remember what things sounded like back then. I know that people’s voices sounded clear, but at this point, that’s merely a semantic memory. The sound itself, the actual sensory experience of it, is something I can’t fully recall.
Does anyone have non-semantic memory of sound, like actually able to play a sound in their head without humming. I cannot. I guess some do, maybe most do, especially those who can sing or play musical instruments.
This inability (inabilities actually, because I can't do visual recall that well either) of mine makes me wish I had those super powers. It would have allowed me to relive wonderful experiences of sight and sound.
At least I can dream and there's photographs and video and audio recordings.
Perhaps there is an evolutionary reason for not having strong sensory experiencial recall capabilities -- one could get dopamine hits simply by recalling and not actually moving and exploring.
I can hear music in my head as if its playing from headphones but only for a short period of time and only if i know the song very well. Basically if i know all the lyrics and the melody pops into my head for any reason i can play the whole song to myself in my mind and just jam out. As far as super powers go its pretty chill ngl.
Edit: just thought id mention a slight draw back, i get a lot of awful and annoying pop songs that can get stuck in my head. If i hear a song in my head and its that clear then often it will just play on repeat over and over until i hear something else, or force myself to think of a different song which is hard to do when you have a song crystal clear playing on the radio in your head.
This grew a lot longer than planned, so I hope it manages to be informative and not just indulgent, lol.
Yes, I can have songs/tracks stuck in my head (though all too often in the form of some obsessively looping motif), or voluntarily "play" them with a varying but generally satisfying degree of accuracy and completeness.
I don't want to exaggerate it though. It's not as if I'm having full-on auditory pseudohallucinations, for one thing (I get to the other thing after a couple more paragraphs). Just as typical visualization is a quasi-visual experience that has a "visual feel" but is distinct from retinal visual input, this is a quasi-auditory experience. It is (for me) clearly not the same as hearing actual sound. It's only some part of the experience that lies somewhere downstream of the physical sensation of sound hitting my eardrums.
But it's not simply all of the perception part with the stimulation part cleanly omitted. Then I can only imagine it would have a hallucinatory nature (which it does for a few[1]). It's further "detached" to some varying degree. Sometimes it's rather effortful, and other times it can feel nearly real in the sense that I don't have to actively make it be there.
Even so, it comes out with what feels like at least adequate fidelity. Right now, for example, while "playing" the beginning of Julie Andrews singing "Do-Re-Mi" from The Sound of Music, it seems like I'm getting a lot of the nuances of her articulation and intonation. Those nuances may or may not be quite accurate to the original, but it's enough to passably emulate the experience of actually listening to it, except for the part where it feels like I have to do a lot of the work myself.
So with one such relatively uncomplicated "stream" to deal with, there is "bandwidth" for a good amount of detail like that. Beyond that it degrades in a way, which brings me to the other thing: It's not as if I'm having a perfectly complete experience in which all the parts are present all at once. There's a focal point (usually the vocals, if present) and usually maybe one other thing can be happening along with it in a way that seems more or less complete and concurrent. Beyond that, parts will fade or drop out entirely, come back during lulls in the other parts, and drop out again. A sort of skeleton that overall delivers an acceptable composite of sorts.
> actually able to play a sound in their head without humming
Some of the research finds (or asserts? argues? submits?) that all of these forms of mental imagery (visual or otherwise) are "aborted" forms of actual experiences or actions. Consider, for example, a spectrum with "reading aloud" (or "speech" generally) at one end, whose aborted form is subvocalization in which the vocal cords and the articulatory parts are minutely but visibly engaged. Then suppose that an experience of fully inner speech is a further aborted form of that. Then maybe something further "inward", like "worded thinking".[2][3]
For a parallel example, consider kinesthetic mental imagery -- imagining doing something physically (not visualization, but what I think your coach really means when he tells you to "visualize" an action). Here, similarly, the skeletal muscles are minutely engaged (according to some paper or other that I can't cite at the moment and am not really qualified to assess). This is, IIRC, shown to be at least somewhat as effective as actually practicing the action, and also hints vaguely that there could be something to your idea about the spoofed dopamine reward.
In this way, with the music, it's kind of like an aborted subvocalization, and if I let it be a sort of subvocalization, with the little movements of the vocal cords, it supports more "streams". I have to do this to just barely manage to "play" a three-note chord such that I feel like I can be aware of each tone at the same time (I say "feel" because it's fragile/shaky enough that I get the sense I could just be doing some deft plate-spinning). All of which (since the quote up there) is to say that I think needing to hum is at least probably on the same continuum rather than being something utterly divorced from some kind of supernatural feat of sound-conjuring.
1. e.g., Brian Wilson of the Beach Boys and his auditory hallucinations of intricate arrangements (See the very beginning of "Wouldn't It Be Nice" for one example of the sort of thing that some will recognize as very obviously originating from such a hallucination): https://en.wikipedia.org/w/index.php?title=Musicianship_of_B...
Makes sense, like "knowing" what a something looks like from memory, and actually having a recent short term memory reference. One is an idea that you'll recognise the real deal from, the other, is close enough to reconstruct a passable version of the real deal from. The former, is all but useless for describing to another what that means or comparing things in isolation in a faithful way.
They remember the narrative of the order of events but not the subjective experience of normal hearing. Quite common for all kinds of experiences, because stories are culturally held.
He explained that he doesn't read/write English. I do find some of the wording strange. However, the paragraphs and overall structure doesn't feel at all like AI slop. YMMV.
Sorry about that. Korean and English are very different languages, so I think some things got lost in translation. I completely understand the AI slop concern, and I take that kind of criticism seriously.
I wouldn't normally describe hearing a voice as hearing "vibrations". Vibrations are indeed the physical basis of sound, and the auditory system detects changes in air pressure caused by them. But vibrations can also be perceived through touch, and the subjective experience of hearing is quite different from the tactile sensation of feeling something vibrate. When talking about feeling vibrations, I usually think of the touching sensation.
Still, both sensations originate from the same physical phenomenon. You can try to feel your own vocal chords vibrate by placing your fingers on your throat while humming. It's certainly a very different sensation, and touch generally conveys fewer acoustic details than typical hearing, but you're sensing the same underlying physical event.
One interesting example is Dani Valeska (Instagram: @daniivaleska), a Brazilian Sign Language interpreter whose husband is deaf (I couldn't find his name). She shares content about their experiences, and I remember seeing a video in which her husband used the vibrations of her voice, felt by touching her throat, to reproduce what she was saying. This resembles a technique called "tactiling", which has been studied as a tactile aid to speechreading (https://researchers.mq.edu.au/en/publications/tactiling-a-us...).
When I was very young, I had normal hearing, but I don’t remember any of the sounds I heard back then. I think I lost my hearing around first grade, which in Korea is around age seven. Until then, my hearing was normal, and that’s when I learned to speak. But these are such early childhood memories that I can’t really be sure. What did everything sound like back then...? I don’t know.
(Sorry if my last post seemed to have some mistakes. I was tired yesterday and didn’t review it carefully, so there were a few contradictions. I’m trying my best to write as accurately as possible)
The vocal vibrate primarily because of the Bernoulli effect and the over pressure of the lungs.
Just vibrations alone, called the voice sources, carries almost none of the information that we use in speech. That information arises as the pressure wave goes up through the larynx tube and into the mouth (or up the nose in the case of nasals). It is possible to measure just the voice source by means of a laryngograph.
Software like Voicemod transforms speaking voice into a bright, robotic, or Miku-inspired digital idol tone in real time. I wonder if this would help in hearing and understanding speech better.
This is an intriguing proposal. In my experience, however, Hatsune Miku's pronunciation is not clearly intelligible upon first hearing one of her songs. The words become distinct only when I read along with the romanized lyrics. With repeated exposure to the same song, I am eventually able to understand it without the lyrics; however, I would argue that this reflects top-down prediction grounded in memory rather than any increase in the clarity of the sound itself. This is analogous to the phenomenon of sine-wave speech, in which sounds initially perceived as meaningless whistles or electronic tones are suddenly heard as clear, intelligible speech once the listener has been shown what is being said.
Yes, I have. For a whole year, I asked about it at every mapping session. But no matter how many times my cochlear implant was remapped, there wasn't much improvement. I still don't know whether the cause lies in my auditory nerve (peripheral) or in how my brain processes sound (central), or something else entirely. I told my audiologist that speech sounds blurred, and I also brought it up with my doctor, but nothing really improved.
Unfortunately, I still don't know the answer. At least to my ears, music sounds clear and beautiful, so why is speech so muffled and hard to understand? My hearing loss remains a mystery. A thorough evaluation at a university hospital might reveal the cause, but nothing I can do on my own will uncover it. For now, I'm left with an unresolved limitation: I can't tell whether the problem lies in the peripheral auditory system, the central auditory system, or the cochlear implant itself.
Without modern AI, I don't think I could have come this far. That said, I'm not an expert, so I believe I should humbly accept whatever criticism comes my way. Although I haven't found the answer yet, I'm grateful to AI for its help. Thank you for your kind words.
Pretty much all of the difficulty arises from the transliteration of Greek ψ, υ, χ, and φ, and then inconsistent pronunciations of these letters themselves in loanwords (including pronouncing υ as both /aɪ/ and /ɪ/)!
That's not to say that it's not very tricky, just that the difficulty kind of arises from one core reason.
Edit: OK, one s as /s/ after the c and another s as /z/ between vowels is also tricky and doesn't have to do with Greek.
> OK, one s as /s/ after the c and another s as /z/ between vowels is also tricky and doesn't have to do with Greek.
The English plural suffix follows a standard pattern:
It’s voiced (/z/) after voiced sounds and voiceless (/s/) after voiceless sounds. That’s why it shows up as /s/ at the end of “physics” (/fɪzɪks/). /k/ is voiceless.
The -ics ending of physics comes from a plural.
No helpful pattern underlying the middle “s” unfortunately.
Yes, there's a general voicing assimilation to the preceding phoneme for both -s and -ed! (plus an additional epenthetic vowel insertion if the suffix consonant is too similar to a preceding consonant) It took me a long time to learn this because I am a native speaker and did it automatically without thinking or initially without even noticing that it was realized differently in different contexts in the first place. It's a really fun example of how we can do fieldwork on ourselves (gather a lot of data and try to derive the rule).
Author here. I'm Korean, and I have cochlear implants in both ears, which I received in a clinical trial in 2025. No one could tell me what I actually hear, so between 11 October and 4 November 2026 I ran seven psychophysical tests on myself (10,992 trials), using browser test apps that Claude built for me. I'm an amateur, so there are surely mistakes, and corrections are very welcome.
Could you try taking a musical track and doing a low-pass filter to remove anything above 100 hz? If it doesn't sound about the same to you, then that is proof that you are hearing and processing some sound above that 70 hz limit. The inability to distinguish speech sounds more like trouble with higher frequencies (which help discriminate between different syllables) than with frequencies in the 100-400 hz range typical of human speaking f0s - because the latter are also vital to what tends to make music sound full and rich.
A sort of anti HN comment to say but very interesting reading, I don’t know if I have answers to any of your questions but thank you for sharing, I will read more and consider it.
I always told myself I would try and do some fun things with my cochlear implant (Med-El Sonnet) but I never did so reading this was like dusting off some old thoughts of mine.
I was the same, I was born relatively hearing, but started to lose it rapidly - due to a mitochondrial disease (mutation A7445G) which is very rare, but is in a few families around the world. I wore hearing aids for most of my childhood and then got the implant when I was mid 20s.
I've heard a lot of your complaints from others. My sister for example, didn't have a great journey, and even today she reckons everything is still robotic sounding. She however went with a Cochlear Nucleus system, and I was the only one in 30+ people in extended family to go with Med-El (because I liked their tech better) and it's always sounded crisp and clear to me.
I'd have liked to have gotten two, but I was only funded for one - plays havoc with directional hearing. You could have 50 people turn towards a sound, and then there's me turning the opposite direction! :)
I'd be really keen to know if you have any other experiments planned.
Something like $10k for the actual device, the surgery is about $50k, and then the costs involved with the audiologists, follow-ups etc. However, the device should be replaced every 5 - 7 years, or it's detrimental to your hearing.
Moisture is a big destroyer. It never occurred to me at the time, but now I am beholden to Med-el for life, it's literally a lifetime subscription :)
I don't have any other experiments planned yet. I'm still thinking hard about what to do next, and honestly, I'm not sure what kind of tests I should try.
Thanks for the writeup!
It's fascinating that you can hook yourself up to a PC and get music played directly into your implant.
I wonder what would happen if you shift all frequencies in a song (or PC microphone capture) into a much smaller range, proportinally? And then test some target ranges.
Or you could slow down a song but keep all the frequencies?
Mi-Rae : this is exactly what I was thinking also.
Metaphor:
If there is a problem with the lunar lander, or the Mars robots we can't easily go fix them, we can't send someone to "turn it off and back on again", so we find a work around instead.
In your case we may not be able to change the physical connections easily, or heal the damage there, but we may still have some options.
...
Most of us here at hackernews are programmers or technologists, not medical experts. So if there is a medical reason / short, malfunction, or other problem with the underlying connection to your brain (or to your brain itself in that small connection area around the implant), that is outside of our expertise.
## Suggestion:
This suggestion to "translate"/transform the speaking ranges DOWN into the ranges that you can actually hear is a great one. So you'd be looking/asking claude for software that would take any/all microphone input at normal speaking frequencies, and in real time, shift/adjust the frequency Downwards until the average speaking midpoint was below 70Hz . then if your brain can hear differences in the lower frequencies, it would just be a matter of training/learning them in those lower frequencies. It may still take some time to hear specific speech, but you need to get it into a range that you can actually detect some changes.
An audio recording or mixing technician may be able to help with suggestions about which frequencies usually contain male, female, child voices and things like "s" sounds or sharper hisses at the end of a sound which tend to be a higher frequency than the main words.
But the main goal would be to make ANY speech detectable to your ears.
There may be multiple ways you could try stretching out or reshaping the word sounds
For faster testing, start with a single recorded word at normal ranges. As a starting place, Have a friend record a single word and verify that they can hear it on your computer when it plays (this is important!).
Then you would try variations for your software to shift the word into lower and lower frequencies until it becomes legible/hearable to your brain. Once you are able to hear something then record the range that its shifting down into as the "sweet spot". Try a few alternatives above and below that spot to try to find your " best" hearing frequencies.
Once you've done that, you'll just need to play that word over and over again until you are able to hear the edges of it, the articulation of the syllables which should sound like hills and valleys. In most languages including English and Korean, The beginnings and the ending sounds (and how abruptly they stop or start), like edges to a sword (wielded by an expert swordsman), or like the movements of a dance (sometimes a slow smooth movement, sometimes an abrupt stop, then movement again). Thise are the same kinds of things we do with our voices to make sounds. A shape of the syllable like a body dancing shape, the lights come up on the stage, then movement(air&vibration) starts in a certain way, then movement (fast or slow) into another mouth shape. Usually the beginning and middle are particularly important, many dialects and creoles tend to drop or slur the ends of words, since if you have already heard the beginning and middle of the word so many times, then you already know the end part. Similarly, if you watch your favorite dance or ballet over and over again, you remember and can know the shape of the body in the next beat before the dancer gets there.
Best of luck on this, please report back if you make any progress, we are all cheering for you, and we hope you're able to make progress!
Reminder: to retrain your brain on different inputs takes time.
Make sure you can hear something in the changes, but then when you're in the "sweet spot" range, give it time. Listen hard! Be a learner and always be expecting for that dancers shape to come through. Spend time doing it every day, maybe with a blindfold so that you can focus ONLY on the sounds, otherwise your smart brain will try to work around it, picking cues from visuals.
Thank you for sharing this. It is all very interesting, and I hope you are able to find out more and experience even more sounds with your implants you do. I would be very interested in being able to experience the tests myself. There are a lot of descriptions of what is being done with the audio, but I have no real intuition as to what any of it actually means. The github repo seems to only have the data in it, and not the tests themselves. Though I could certainly be missing them as well. Including the tracks, or code used the generate the tracks, would be nice.
Thank you so much for your kind words and for taking a close look at the repo. You’re right, it currently only contains the data, not the tests or the tracks themselves. I’m really sorry about that. I work a full-time job, so I can’t upload them right away, but I will add the test tracks and the code used to generate them later.
This was beautiful to read. Thank you for writing it! Don’t worry about it reading like slop - your voice comes through very distinctly to me.
You mention a lot of ethics concerns; I am totally uneducated on medical ethics but I think those are pretty important questions. It doesn’t sound like you’ve had a lot of support from this startup.
I might suggest to you that you publish this on a website - GitHub pages comes to mind as something Claude or codex could do for you easily - it would let you segment this information in a way that someone who wanted to help with the medical questions could get right to that stuff, and someone who wanted to help with ethics could also jump to what they were interested in.
Either way, thank you for the write up! Your curious and open attitude is lovely.
I don't do programming myself, but I'll look into GitHub Pages. I'm deeply grateful for your advice. I've been making clear and repeated requests to the startup, but for some reason, they haven't accepted them for a whole year, and I honestly feel so sad about it.
Have you tried listening to chiptune, MIDI, or electronica music? I am congenitally hearing-impaired myself and also enjoyed Vocaloid, although I had never wondered about a connection before. I've sometimes thought that when Vocaloid producers don't try for realism but go for simpler easier 'purer' Vocaloid voices, it sounded like chiptune/MIDI/electronic. So those might be an interesting musical control group.
I haven't listened to much chiptune, MIDI, or electronica, so I'm not very familiar with them. But after hearing about your experience, I think I should look them up and give them a listen. Thank you for the great suggestion.
I'm glad to hear you discuss listening to music. There's no doubt it will sound different to you, but still well worth enjoying. My best wishes to you for an interesting, and I hope exciting time in your life.
Thank you so much. Speech sounds muffled and blurry to me, but music always sounds so beautiful and lovely. It truly is beautiful. I hope you also have many happy moments listening to beautiful music.
Thank you, I really appreciate your comment. I've never really studied English, so I needed help from an AI translator. Because of that, I was very worried even before posting. Thank you for your encouragement.
This is interesting and I'm going to write out my thoughts for you here. Just some impressions.
Right off the bat after skimming this I'm caught up with a detail that you confirm multiple times - that you can tell literally nothing apart given any input over 70 hz. You have had this measured a few times and you definitely say that nothing is coming across above 70 hz.
Yet you are trying to hear all sorts of things that have most all of their information content above 70hz.
The Hatsune Miku music? You're hearing the bass and the kick drums and maybe some subharmonics generated in the reverberation of the higher stuff. But that is a tiny fraction of the music, and, I hate to tell you this, but that computer girl singing is all way, waaay up higher than 70hz. The beautiful sounds you are getting across are the cool synth basses of all that music. It's very modern, punchy music and the bass of that type of electronic music is very different from other classical music so whatever modulation your implants are doing to it from 70 hz down likely sounds very cool compared to a lot of other music, for sure.
But, stop- you're getting nothing by noise and wind sounds with no information differentiation over 70hz because your brain isn't demodulating that information, maybe due to something about how the implant was... implanted... or just your specific condition, who knows, but what you can do is work in the band you have.
You mention not getting human voices because the fundamentals of human voices are more than 2x where your cutoff is.
Have you tried using a program like Audacity - or - Get claude to write a script for you that takes in MP3's of modern music and slows them down 300-400 %. The music will be very slow, but it will shift instruments from higher up (pianos, horns, people's signing) down into the 20-70 hz range, and you will maybe hear patterns that are new. Did no one in the study post-op sit with you and go thru this kind of thing? You have all these external trials listed but most all of it is moot if everything above 70hz is missing and you aren't able to modify the modulator hardware.
Note that the type of rhythms in the bass of the bass synthesizers of that Hatsune Miku tracks are different that the more complex rhythms and melodies played by instruments higher up (like pianos and lead synths). (This is true for most all music genres...) Shifting those higher up things down in frequency, even if that means they play back slower, may give you an different musical experience.
Continuously pegging your implant modulation hardware with frequency content above 70hz attempting to discover something about how it interacts with your brain when you continuously get nothing but broadband noise over 70hz seems like a dead end exercise.
I mean hell, have you tried putting a low pass filter to block out on everything in the music/microphone input above 70hz just to make sure that information isn't somehow overloading the way the implant works with your brain, and maybe just causing confusion.
Lastly it sounds like you could benefit from talking with someone with a real audio / digital signals processing / electrical engineering background that can inspect your hardware directly and make suggestions because educating yourself with just GPT runs might be spinning you in circles.
For instance... you mention things like "
The logic of my test apps, which generate the test sounds and move the staircases, was checked with the Lean 4 formal verifier,"
Man... this has nothing to do with needing a 'Lean 4 formal verifier' to check your app or whatever. You need someone to sit with you and your damn hardware and work with some audio input. You need the someone that setup the original implant modular to explain the hardware mapping and filtering options to you and see if you can go back and change how that works, to get more options. You're getting some wildly mixed signals (bad pun) about how all this works, I think.
> Have you tried using a program like Audacity - or - Get claude to write a script for you that takes in MP3's of modern music and slows them down 300-400 %. The music will be very slow, but it will shift instruments from higher up (pianos, horns, people's signing) down into the 20-70 hz range, and you will maybe hear patterns that are new
You don't need to slow them down, you can just pitch shift everything into the 0-70 hz range. If there were a way to figure out how his brain is demodulating the signal, you might even get something pretty reasonable out - the essay describes sounds like cars as hissy rather than heavy.
The real difficulty is keeping genuinely inaudible frequencies (<40 hz? but who knows how his implant works) from swamping the rest, I would think.
I didn't mention just pitch shifting alone without speed change as depending on how that is done it can introduce artifacts. So just slowing things down like an oldschool tape player is the most 'pure'.
Any computer sound card will high-pass anything over about 16-18 hz and thus new lower stuff won't swamp, and it seems like his implant amplifier does indeed deal with low frequencies because he mentions using an 18hz tone to keep the device key'ed on.
Another thing then to mention would be 'binning' audio that has been pitch shifted own using notch filters / comb filters. Because it is possible that however the implant is wired could use some band gaps to help his brain 'decode' things more clearly and less muddy.
Again, all this is simple shit and I find it really surprising that there isn't someone to help run these tests on hardware with this person, and their blog post here has this very strange rabbit hole feel to it and I can't tell if it is because there is a lot lost in translation, or if there is a lot more to this that is coming across in translation... or if this person in being led down some near-AI-psycosis and is struggling because they simply don't have someone to sit with that can help.
I think there's a misreading at the root of this. The "70 Hz" in the post is the modulation rate from the TMTF, not an audio frequency. The TMTF measures how fast loudness can flutter before the flutter is undetectable. It isn't a pitch or discrimination test. From the post, OP does discriminate, somewhat, above 70 Hz and says they can't judge pitch direction at all, so there is no 20–70 Hz "working band" to retreat into.
I agree with the broader instinct that OP deserves a clinician to help with the hardware side (having their map and device parameters alone would go a long way), but it seems OP is taking any step they can towards this effort.
I regret that I don't have anything to actually add towards helping OP. Their posture towards understanding is refreshing and the Lean bit reads to me more as a cute testament to that than anything eerie or strange.
I re-read it and looking more at the tests and... I think you're right but also maybe OP is confused about how the audio spectrum works in general then, because they themselves talk about this 70hz shelf in the same breath as human vocal ranges etc -- that isn't amplitude modulation frequency. But maybe there is just something here that is lost in translation or I'm just not getting the real purpose of these test measurements.
If I'm a bit more imaginative on this 2nd read of their 'experience' of these tests it seems that maybe yes, they hear 'something' at higher frequencies but it just just broadband noise- broadband noise mind you, is, all frequencies... so I was confused at how someone could say they 'don't hear anything above 70hz' and yet can somehow hear 'noise' at '2000 hz'. But it is dawning on me that the implant / associated driver hardware may simply be 'saturating' when the spectral content of audio is too large at all those frequencies, and OP can actually 'hear' something, but it just blurs into white noise when the spectral power is too high - kinda like there is a massive amount of reverb being applied to everything over 70hz.
But again they talk about their struggles with understanding voices and whatnot but if they are hearing parts of music at all then they could be hearing people' voices shifted into bands and toned down to amplitudes that helps them.
Like, clinicians with experience here should be helping with this and it is kinda insane that this person is attempting to discern anything themselves.
The exposition is strange and again that could just be the translation and writing style but some of those little bits and just the way I've seen some people literally start spiraling when they start to pair-autodiadict with AI - coupled with the fact this is a medical condition and a life-altering disability - along with a few other small oddities in this post - make me kinda worried there is a lot more to this than posted and OP may need other kinds of help with their situation.
> ... maybe OP is confused about how the audio spectrum works in general then, because they themselves talk about this 70hz shelf in the same breath as human vocal ranges etc -- that isn't amplitude modulation frequency.
In a CI, voice pitch actually _does_ arrive as amplitude modulation at the F0 rate. The processor keeps only each channel's envelope, and the harmonics of a voice that share a channel beat against each other at F0. So a 70 Hz flutter ceiling and vocal ranges do belong in the same breath.
> ... so I was confused at how someone could say they 'don't hear anything above 70hz' and yet can somehow hear 'noise' at '2000 hz'. But it is dawning on me that the implant / associated driver hardware may simply be 'saturating' ...
The TMTF carrier was noise by design, so above 70 Hz the flutter vanished and the noise that was already there is all that's left. No saturation is needed to explain it. The “wind” in SRD is what a spectral ripple sounds like through limited spectral resolution. This is a resolution problem, not a level problem.
> The exposition is strange and again that could just be the translation and writing style...
This paragraph was why I initially made a comment. They were radically honest with their methodology and obviously living inside the problem. OP is actually reading this thread, for what it's worth.
What is the point of using your account to generate replies like this? Even your use of "Sorry" is obviously vapid. Try addressing my comment or don't participate.
Thank you for pointing out that the 70 Hz is a modulation rate, not an audio frequency. That's exactly right. I wish I could find someone in Korea to help me with the hardware side, but no matter how hard I've tried to persuade people, I've mostly been ignored. As for the Lean part, I wasn't sure whether it was really necessary. I've never been part of academia, so I'm still very clumsy and amateurish at this. Even so, I'll keep doing my best to find someone who can help with the hardware side. Thank you for your kind words.
That is definitely the weirdest part to me. It is supposed to be a trial for this new implant right? So why isn't the company actually working with them on it? Like how is just telling someone do more therapy acceptable here? Studying their brain's reactions to the stimulus the implant is actually generating seems like something that should have already been done.
I would think you could take the audio processor out of the loop and run diagnostics on the implant itself using an EEG to determine how the brain is responding. They test the hearing of newborns with the tech, you don't need to "trust" a person or even need them to be able to communicate. Its right there in the data.
Based on my read of everything it feels like there is some issue with the implant sending electrical signals, but the nerve not actually picking them up and sending them on. Perhaps related to the original reason for the hearing loss. And the company should want to dig info it more. I know I would if it were my tech.
I pleaded with the cochlear implant company to do research, telling them I desperately wanted to know exactly how I hear, but unfortunately, the only answer I got was that it would be difficult. It makes me feel so sad and helpless.
I was tired yesterday, and I have very little experience writing, so I fully respect the criticism that the post feels messy and strange. I think some parts were accidentally lost in the translation process. As you said, I don't have a single person around me who can help with this, so I've been relying on AI. But I'm consciously keeping myself grounded so that I don't fall into anything like AI psychosis. I'm sorry that the post wasn't better written.
I think the presentation of the whole situation was just a bit jarring to me because it is a wild combination of topic (the hearing implant) coupled with the fact you had to translate (can always be difficult with such a technical topic) while using AI to summarize and edit your entire investigation, published as a Claude artifact - we're really seeing a new kind of blogging here, and that for sure caught me off guard.
I see your situation more clearly after re-reading and also seeing your new responses here in these threads.
I think if you write more on this topic, especially more about your history of hearing and what you can in fact perceive, and publish more on the internet, you will find people who are very interested in this kind of topic - it is something that will 'nerd snipe' many tech minded people - and I am sure you could absolutely make friends in Korea who are interested to help. Having someone with an audiology background, or even a student in neurology who knows their way around audio signals processing / has a DSP / EE background etc. sit in with you for some experiments as you use the line input for you device - someone who also hears what the input is, and can talk with you about it - would be invaluable and could also be a fun social connection- maybe university students, etc. If I spoke Korean and lived in your city I would definitely find it fascinating to try and help out.
Yeah, ordinary hearing is normally quoted as 20Hz to 20kHz, but most people are hearing mostly between 2000 to 5000Hz. If truly there was no perception above 70Hz that would lead to a very muddy and indistinguishable soundscape.
> most people are hearing mostly between 2000 to 5000Hz
That's pretty misleading, we tend to have excellent hearing anywhere in the 100 hz - 6000 hz range. Much of music and all fundamental frequencies produced by the human voice (except people with very rare whistle register abilities) is below 2000 hz. We're most sensitive to the range you're talking about because it's the most useful for discriminating between different sounds, but still only slightly more sensitive to that range than to lower frequencies.
I understood that they are able to hear pure base tones at higher frequencies. But once they are modulated quicker than 70 Hz (implant electrodes are switched more quickly than that) then it turns into white noise. That would fit with the "all voices are the same" description where everything is reduced to base frequency, without harmonics.
I would also be very curious about taking the music, and slicing it into different frequency ranges. And playing each of the ranges independently. A tone on its own may be perceived differently than a wider range of frequencies combined. Especially when there is a black box audio processor in the middle. Perhaps it is filtering out those consistent tones in some way to minimize the "noise" and keep just what it thinks is the signal. Like built in noise canceling headphones.
I also think there are some relatively cheap options for getting or building a simple EEG. At least in the US, I don't know about Korea. Which could allow for some more interesting tests. Let it play various sounds and tones while recording with no visual stimulus to go with it, and see how they correspond to the EEG data.
You should just frequency shift, not slow things down. Maintaining a train of thought trying to understand what someone is saying becomes very difficult when it is slowed down.
A looping 10 to 70 Hz sweep got the best result with my 20+ year old Apple sound sticks because they have a subwoofer.
With typical hearing, it sounds like almost a dozen distinct frequencies to me. Higher frequencies are just a matter of degree, they aren't qualitatively different IMHO. But I'm not musically inclined, and only have synesthesia when I sort of see color in various gray patterns on the computer screen, which look more blue or whatever sometimes, so I'm sure someone will disagree with me because they sense feelings in audio that I don't.
I'd bet that improvements in technology over the next few years (especially with the help of AI) might get the upper end to perhaps 100 Hz or more, where it begins to sound more like a tone than a hum. Loosely, a beat (like a drum) sounds like perhaps 10 to 20 Hz. A hum sounds like 60 Hz (like electricity). Also I wonder if a cochlear implant can hear below 10 Hz because it's electrical stimulation instead of physical, to maybe hear frequencies that typical hearing can't? But I don't know.
I'm fascinated by this stuff, because sometime in the next 5-10 years we'll get direct digital signal to nerve implants. That could allow people to hear above 20 kHz (like a dog) or even restore smell in people who have had it diminished due to illness or injury.
Many people can see ultraviolet light after getting cataract surgery, which supposedly looks like a blacklight but more blue because there is a little rise in the red visual receptor the overlaps blue to make violet. So technically the blue receptor ends up being a violet receptor because red isn't removed normally. Which means that violet and purple are different colors, because the visual cortex makes sense of them differently at opposite ends of the spectrum based on how much green is present. Of course all of those distinctions may go away when someday the visual nerves can be stimulated directly with an implant and make color more of a continuous spectrum like sound, rather than having distinct color bands like in a rainbow.
Subjectively, I've noticed when I wake up in the morning that the ceiling has grey and yellow splotches, because we have fewer blue receptors in the fovea at the center of the eye, and they haven't adjusted yet. Also at dusk, the rods begin to sense more, so the world fades from color to cyan and then gray. I feel like similar things might happen with audio, because I feel like I can hear better when I'm camping, especially in the morning, but I don't know why.
There are interesting experiments where they put goggles on chickens to flip the world upside down. After 2 weeks, the chickens saw normally again due to neuroplasticity. Then when they took the goggles off, the chickens walked goofy until their brains readjusted.
Also I've read that lion's mane mushrooms regrow neural connections and may even increase neuron synthesis. I've had neurological injuries due living a rough and tumble life that seemed to have healed somewhat after drinking mushroom coffee for a few weeks. Also magic mushrooms scramble nerve connections and let them reestablish themselves, sort of like starting over with a blank slate in neural networks. Mushroom medicine research has been blocked by a century of ignorant legislation, so people have missed out on spiritual healing that strays outside of what science can explain. I think of a brain or neural net as an antenna that resonates with the consciousness field, which is some sort of 5D-like field that transcends our normal 4D spacetime (otherwise it would be a frozen crystal with no observer or passage of time). When our brains get rewired after learning/trauma/injury/illness/healing, our attention shifts to different things, which alters our subjective experience. Meaning that in a very real sense we perceive the world differently and/or feel like we've shifted to a different (often better) timeline. Plant medicines and spiritual practices may allow changes to subjective experience that science can't yet talk about.
Anyway, not sure what point I'm trying to make here with these breadcrumbs, other than that the future isn't written yet, and in fact there are infinite futures, which I believe free will allows us to choose. So there is always hope and a reason to keep going.
You clearly have the hacker mindset (compliment). I hope your investigations are fruitful, for yourself and others who may learn from your experiences!
Thank you. Your compliment really encourages me. This is something I had always been thinking about, and I feel I was able to make it happen with the help of AI. But I still have a lot to learn, so I welcome criticism too. Even so, your kind words mean a lot to me.
>Those of you who hear the world in three dimensions would know the answer, but am I hearing a flat plane?
You typically should feel sound as a 3d point, it maps roughly to the same sensory system that maps light or touch direction. Loud noise would feel as directional and material as bright sun or strong poke to a head. (Brain does this mapping transparently based on the small difference of time it takes the sound to reach your ears.) Sometimes the sound is not clear, you would either hear from a vague direction or with no direction channel provided from your brain at all.
> the small difference of time it takes the sound to reach your ears.
The science behind Head Related Transform Functions [0] is fascinating, and includes additional tricks. For example, the shaped fleshy bits of your ears modify incoming sound differently depending on the direction, so that the noise from "up and in front" has a signature which differs from "down and behind". There's also a component that comes from sound traveling through your head, where traveling through the front is different than traveling though the back.
I particularly remember this because long ago I had an Aureal A3D [1] sound-card which made great positional sound (over headphones) by simulating HRTFs and sound-reflection off of game-world geometry. Unfortunately they were sued into bankruptcy by Creative, whose EAX technology was much less-impressive.
The culture here is pretty split. Honestly, there's a sizeable contingent that will likely flame/flag you for mere use of AI. Try not to take it too hard; they don't represent everyone and I at least thought your post was a valuable addition here.
Please don't take HN threads on generic tangents [1] and especially not snarky ones. This isn't a response to the article - it's simply repeating a pre-existing association to a recognized name.
We're trying for more interesting conversation here and that requires specifics, not generics.
Another way of putting this is that we want reflective comments rather than reflexive ones [2].
Agreed on all points, and I'd like to point out that most GE appliances aren't actually made by GE. They're essentially selling their name to a manufacturer. Wouldn't be surprised if Samsung is the same.
Frankly a dumb move since it tarnishes their brands, but.. profits?
ENT surgeon who has bilateral CIs and has been in the research field for 20+ years. This sort of stuff is cool, but there are lots of limitations at the auditory nerve interface that limits improvements to speech and music processing strategies. Crazily enough, many of these studies were done in the 1960s to 1990s and are still valid today. There are strategies that can help at individual level, but do not help everyone. Thus they have not made it to clinical use.
I am deeply grateful for your words. It has been just over a year since I received my cochlear implant. Thanks to you, I learned for the first time today that this methodology is not yet mature enough to be used in clinical practice. I started this because I wanted to understand the sounds of the world I now hear, but there is still so much I don't know. That is why I am actively participating in and collaborating on cochlear implant research in Korea as much as I can. I also sincerely thank you for your dedication to advancing science.
Thanks for posting. If you have time to write some more thoughts on those limits and individual strategies I'm sure it would be interesting to many of us here.
I agree, it would be very interesting
Is there any research into other ways to 'get sound into the brain', generally speaking? If so: some pointers would be much appreciated.
After being hard-hearing since early childhood (bad living conditions -> tuberculosis -> ototoxic antibiotic, streptomycine iirc), my mum had a CI for a # of years. But due to infections, it got removed at some point. Since then I've always wondered if there's other routes to get sound into the brain. Say, using vibrations on the skin. Or an electrode-stuffed 'helmet' of sorts.
Even if temporary, it can be a life-changing experience for someone who's never experienced sound.
Any research in that direction?
I have history of hearing losss and a more recent episode of bilateral SSHL post viral infection with relatively decent recovery. I am left me with deficient sloping loss in the high frequencies 50-60 db. I wonder if the day will come when I will need CI. So far I can manage but since medically no doc is able to point out the cause of the loss I’m starting to familiarize myself with them. I hope progress is being made on CI front and the regenerative one as well
> But I cannot know what sound is really like, because I have no memory of normal hearing.
and
> I was born with normal hearing. I began losing my hearing in childhood ... After I was registered, I started wearing hearing aids. People's voices became clear, and for a few months things were good. ... A specialist told me that I badly needed cochlear implant surgery, but I hesitated because it was very expensive.
I'm confused what's going on here.
I was born with normal hearing and acquired language while I still had it. But now, no matter how hard I try to think back, I can’t remember what things sounded like back then. I know that people’s voices sounded clear, but at this point, that’s merely a semantic memory. The sound itself, the actual sensory experience of it, is something I can’t fully recall.
Does anyone have non-semantic memory of sound, like actually able to play a sound in their head without humming. I cannot. I guess some do, maybe most do, especially those who can sing or play musical instruments.
This inability (inabilities actually, because I can't do visual recall that well either) of mine makes me wish I had those super powers. It would have allowed me to relive wonderful experiences of sight and sound.
At least I can dream and there's photographs and video and audio recordings.
Perhaps there is an evolutionary reason for not having strong sensory experiencial recall capabilities -- one could get dopamine hits simply by recalling and not actually moving and exploring.
I can hear music in my head as if its playing from headphones but only for a short period of time and only if i know the song very well. Basically if i know all the lyrics and the melody pops into my head for any reason i can play the whole song to myself in my mind and just jam out. As far as super powers go its pretty chill ngl.
Edit: just thought id mention a slight draw back, i get a lot of awful and annoying pop songs that can get stuck in my head. If i hear a song in my head and its that clear then often it will just play on repeat over and over until i hear something else, or force myself to think of a different song which is hard to do when you have a song crystal clear playing on the radio in your head.
It is always illuminating to understand the inner worlds of others.
I can recall some short clips in "mind's ears" but for very few pieces of music and for short clips.
This grew a lot longer than planned, so I hope it manages to be informative and not just indulgent, lol.
Yes, I can have songs/tracks stuck in my head (though all too often in the form of some obsessively looping motif), or voluntarily "play" them with a varying but generally satisfying degree of accuracy and completeness.
I don't want to exaggerate it though. It's not as if I'm having full-on auditory pseudohallucinations, for one thing (I get to the other thing after a couple more paragraphs). Just as typical visualization is a quasi-visual experience that has a "visual feel" but is distinct from retinal visual input, this is a quasi-auditory experience. It is (for me) clearly not the same as hearing actual sound. It's only some part of the experience that lies somewhere downstream of the physical sensation of sound hitting my eardrums.
But it's not simply all of the perception part with the stimulation part cleanly omitted. Then I can only imagine it would have a hallucinatory nature (which it does for a few[1]). It's further "detached" to some varying degree. Sometimes it's rather effortful, and other times it can feel nearly real in the sense that I don't have to actively make it be there.
Even so, it comes out with what feels like at least adequate fidelity. Right now, for example, while "playing" the beginning of Julie Andrews singing "Do-Re-Mi" from The Sound of Music, it seems like I'm getting a lot of the nuances of her articulation and intonation. Those nuances may or may not be quite accurate to the original, but it's enough to passably emulate the experience of actually listening to it, except for the part where it feels like I have to do a lot of the work myself.
So with one such relatively uncomplicated "stream" to deal with, there is "bandwidth" for a good amount of detail like that. Beyond that it degrades in a way, which brings me to the other thing: It's not as if I'm having a perfectly complete experience in which all the parts are present all at once. There's a focal point (usually the vocals, if present) and usually maybe one other thing can be happening along with it in a way that seems more or less complete and concurrent. Beyond that, parts will fade or drop out entirely, come back during lulls in the other parts, and drop out again. A sort of skeleton that overall delivers an acceptable composite of sorts.
Some of the research finds (or asserts? argues? submits?) that all of these forms of mental imagery (visual or otherwise) are "aborted" forms of actual experiences or actions. Consider, for example, a spectrum with "reading aloud" (or "speech" generally) at one end, whose aborted form is subvocalization in which the vocal cords and the articulatory parts are minutely but visibly engaged. Then suppose that an experience of fully inner speech is a further aborted form of that. Then maybe something further "inward", like "worded thinking".[2][3]For a parallel example, consider kinesthetic mental imagery -- imagining doing something physically (not visualization, but what I think your coach really means when he tells you to "visualize" an action). Here, similarly, the skeletal muscles are minutely engaged (according to some paper or other that I can't cite at the moment and am not really qualified to assess). This is, IIRC, shown to be at least somewhat as effective as actually practicing the action, and also hints vaguely that there could be something to your idea about the spoofed dopamine reward.
In this way, with the music, it's kind of like an aborted subvocalization, and if I let it be a sort of subvocalization, with the little movements of the vocal cords, it supports more "streams". I have to do this to just barely manage to "play" a three-note chord such that I feel like I can be aware of each tone at the same time (I say "feel" because it's fragile/shaky enough that I get the sense I could just be doing some deft plate-spinning). All of which (since the quote up there) is to say that I think needing to hum is at least probably on the same continuum rather than being something utterly divorced from some kind of supernatural feat of sound-conjuring.
1. e.g., Brian Wilson of the Beach Boys and his auditory hallucinations of intricate arrangements (See the very beginning of "Wouldn't It Be Nice" for one example of the sort of thing that some will recognize as very obviously originating from such a hallucination): https://en.wikipedia.org/w/index.php?title=Musicianship_of_B...
2. https://www.hurlburt.faculty.unlv.edu/codebook.html#target4
3. And maybe all of these different forms of imagery-as-aborted-stimulation converge into "unsymbolized thinking"?
Thanks for taking out the time for this reply. Visual imagery I have some, audio less so and olfactory positively zero.
Aborted experience has the right ring to it.
It is always interesting to explore the inner world of someone else, be it with such a limited channel of language.
Makes sense, like "knowing" what a something looks like from memory, and actually having a recent short term memory reference. One is an idea that you'll recognise the real deal from, the other, is close enough to reconstruct a passable version of the real deal from. The former, is all but useless for describing to another what that means or comparing things in isolation in a faithful way.
They remember the narrative of the order of events but not the subjective experience of normal hearing. Quite common for all kinds of experiences, because stories are culturally held.
My wife lost hearing before she turned 2. There's plenty of space between being born and forming permanent memories.
They might be speaking from the memories of their family members rather than their own.
I guess it's childhood amnesia[1].
[1] https://en.wikipedia.org/wiki/Childhood_amnesia
They might have started losing it at an early stage of their childhood.
It’s AI slop.
He explained that he doesn't read/write English. I do find some of the wording strange. However, the paragraphs and overall structure doesn't feel at all like AI slop. YMMV.
Sorry about that. Korean and English are very different languages, so I think some things got lost in translation. I completely understand the AI slop concern, and I take that kind of criticism seriously.
No, you're the witch!
> What is it like to hear vocal folds vibrate?
I wouldn't normally describe hearing a voice as hearing "vibrations". Vibrations are indeed the physical basis of sound, and the auditory system detects changes in air pressure caused by them. But vibrations can also be perceived through touch, and the subjective experience of hearing is quite different from the tactile sensation of feeling something vibrate. When talking about feeling vibrations, I usually think of the touching sensation.
Still, both sensations originate from the same physical phenomenon. You can try to feel your own vocal chords vibrate by placing your fingers on your throat while humming. It's certainly a very different sensation, and touch generally conveys fewer acoustic details than typical hearing, but you're sensing the same underlying physical event.
One interesting example is Dani Valeska (Instagram: @daniivaleska), a Brazilian Sign Language interpreter whose husband is deaf (I couldn't find his name). She shares content about their experiences, and I remember seeing a video in which her husband used the vibrations of her voice, felt by touching her throat, to reproduce what she was saying. This resembles a technique called "tactiling", which has been studied as a tactile aid to speechreading (https://researchers.mq.edu.au/en/publications/tactiling-a-us...).
The essay is a little odd because the author mentioned that she was born with normal hearing.
When I was very young, I had normal hearing, but I don’t remember any of the sounds I heard back then. I think I lost my hearing around first grade, which in Korea is around age seven. Until then, my hearing was normal, and that’s when I learned to speak. But these are such early childhood memories that I can’t really be sure. What did everything sound like back then...? I don’t know.
(Sorry if my last post seemed to have some mistakes. I was tired yesterday and didn’t review it carefully, so there were a few contradictions. I’m trying my best to write as accurately as possible)
Sounds like you might have auditory aphantasia. How's your minds eye?
That’s where I was lost too. Maybe very young and has no memories?
Supposedly, the deaf-blind Helen Keller learned to speak clearly in the same way.
The vocal vibrate primarily because of the Bernoulli effect and the over pressure of the lungs. Just vibrations alone, called the voice sources, carries almost none of the information that we use in speech. That information arises as the pressure wave goes up through the larynx tube and into the mouth (or up the nose in the case of nasals). It is possible to measure just the voice source by means of a laryngograph.
Their GitHub repo with all of their data is here: https://github.com/mi-rae-lab/ci-psychophysics-data
Software like Voicemod transforms speaking voice into a bright, robotic, or Miku-inspired digital idol tone in real time. I wonder if this would help in hearing and understanding speech better.
> Voicemod
> Miku
Interestingly, the same researcher in charge of the VOCALOID software is now in charge of research for Voicemod.
This is an intriguing proposal. In my experience, however, Hatsune Miku's pronunciation is not clearly intelligible upon first hearing one of her songs. The words become distinct only when I read along with the romanized lyrics. With repeated exposure to the same song, I am eventually able to understand it without the lyrics; however, I would argue that this reflects top-down prediction grounded in memory rather than any increase in the clarity of the sound itself. This is analogous to the phenomenon of sine-wave speech, in which sounds initially perceived as meaningless whistles or electronic tones are suddenly heard as clear, intelligible speech once the listener has been shown what is being said.
Have you reached out to your doctors to see if your implant mapping could be adjusted and improved?
Yes, I have. For a whole year, I asked about it at every mapping session. But no matter how many times my cochlear implant was remapped, there wasn't much improvement. I still don't know whether the cause lies in my auditory nerve (peripheral) or in how my brain processes sound (central), or something else entirely. I told my audiologist that speech sounds blurred, and I also brought it up with my doctor, but nothing really improved.
Do you know if your loss is due to damage to the inner ear or something deeper in the chain?
Unfortunately, I still don't know the answer. At least to my ears, music sounds clear and beautiful, so why is speech so muffled and hard to understand? My hearing loss remains a mystery. A thorough evaluation at a university hospital might reveal the cause, but nothing I can do on my own will uncover it. For now, I'm left with an unresolved limitation: I can't tell whether the problem lies in the peripheral auditory system, the central auditory system, or the cochlear implant itself.
Probably one of the best uses of AI that I've seen so far.
Without modern AI, I don't think I could have come this far. That said, I'm not an expert, so I believe I should humbly accept whatever criticism comes my way. Although I haven't found the answer yet, I'm grateful to AI for its help. Thank you for your kind words.
I'm realizing what an utterly wild English language word "psychophysics" is for new learners. It's so many conflicting sounds and rules in one.
Pretty much all of the difficulty arises from the transliteration of Greek ψ, υ, χ, and φ, and then inconsistent pronunciations of these letters themselves in loanwords (including pronouncing υ as both /aɪ/ and /ɪ/)!
That's not to say that it's not very tricky, just that the difficulty kind of arises from one core reason.
Edit: OK, one s as /s/ after the c and another s as /z/ between vowels is also tricky and doesn't have to do with Greek.
> OK, one s as /s/ after the c and another s as /z/ between vowels is also tricky and doesn't have to do with Greek.
The English plural suffix follows a standard pattern:
It’s voiced (/z/) after voiced sounds and voiceless (/s/) after voiceless sounds. That’s why it shows up as /s/ at the end of “physics” (/fɪzɪks/). /k/ is voiceless.
The -ics ending of physics comes from a plural.
No helpful pattern underlying the middle “s” unfortunately.
Yes, there's a general voicing assimilation to the preceding phoneme for both -s and -ed! (plus an additional epenthetic vowel insertion if the suffix consonant is too similar to a preceding consonant) It took me a long time to learn this because I am a native speaker and did it automatically without thinking or initially without even noticing that it was realized differently in different contexts in the first place. It's a really fun example of how we can do fieldwork on ourselves (gather a lot of data and try to derive the rule).
Author here. I'm Korean, and I have cochlear implants in both ears, which I received in a clinical trial in 2025. No one could tell me what I actually hear, so between 11 October and 4 November 2026 I ran seven psychophysical tests on myself (10,992 trials), using browser test apps that Claude built for me. I'm an amateur, so there are surely mistakes, and corrections are very welcome.
All trial-level data, the analysis code and Lean 4 checks of the apps' logic are on GitHub (non-commercial licenses): https://github.com/mi-rae-lab/ci-psychophysics-data
I do not speak English. The page was translated with Claude, and I will use AI to read and answer replies, so my answers may be slow.
This is my first time visiting Hacker News, and my first post here. I don't know the culture here well yet, but I deeply respect it and support it.
It is past 1 a.m. here in Korea and I am very tired, so I need to get some sleep. I will check back around 9:30 a.m. Korean time (00:30 UTC).
Could you try taking a musical track and doing a low-pass filter to remove anything above 100 hz? If it doesn't sound about the same to you, then that is proof that you are hearing and processing some sound above that 70 hz limit. The inability to distinguish speech sounds more like trouble with higher frequencies (which help discriminate between different syllables) than with frequencies in the 100-400 hz range typical of human speaking f0s - because the latter are also vital to what tends to make music sound full and rich.
A sort of anti HN comment to say but very interesting reading, I don’t know if I have answers to any of your questions but thank you for sharing, I will read more and consider it.
Thank you, I really appreciate you taking the time to read it. Even without answers, kind words like this mean a lot to me.
Pretty fascinating read up!
I always told myself I would try and do some fun things with my cochlear implant (Med-El Sonnet) but I never did so reading this was like dusting off some old thoughts of mine.
I was the same, I was born relatively hearing, but started to lose it rapidly - due to a mitochondrial disease (mutation A7445G) which is very rare, but is in a few families around the world. I wore hearing aids for most of my childhood and then got the implant when I was mid 20s.
I've heard a lot of your complaints from others. My sister for example, didn't have a great journey, and even today she reckons everything is still robotic sounding. She however went with a Cochlear Nucleus system, and I was the only one in 30+ people in extended family to go with Med-El (because I liked their tech better) and it's always sounded crisp and clear to me.
I'd have liked to have gotten two, but I was only funded for one - plays havoc with directional hearing. You could have 50 people turn towards a sound, and then there's me turning the opposite direction! :)
I'd be really keen to know if you have any other experiments planned.
> I'd have liked to have gotten two, but I was only funded for one
How much do these cost?
Something like $10k for the actual device, the surgery is about $50k, and then the costs involved with the audiologists, follow-ups etc. However, the device should be replaced every 5 - 7 years, or it's detrimental to your hearing.
Moisture is a big destroyer. It never occurred to me at the time, but now I am beholden to Med-el for life, it's literally a lifetime subscription :)
I don't have any other experiments planned yet. I'm still thinking hard about what to do next, and honestly, I'm not sure what kind of tests I should try.
Thanks for the writeup! It's fascinating that you can hook yourself up to a PC and get music played directly into your implant. I wonder what would happen if you shift all frequencies in a song (or PC microphone capture) into a much smaller range, proportinally? And then test some target ranges. Or you could slow down a song but keep all the frequencies?
AI can write such programs quickly.
Mi-Rae : this is exactly what I was thinking also.
Metaphor: If there is a problem with the lunar lander, or the Mars robots we can't easily go fix them, we can't send someone to "turn it off and back on again", so we find a work around instead. In your case we may not be able to change the physical connections easily, or heal the damage there, but we may still have some options. ...
Most of us here at hackernews are programmers or technologists, not medical experts. So if there is a medical reason / short, malfunction, or other problem with the underlying connection to your brain (or to your brain itself in that small connection area around the implant), that is outside of our expertise.
## Suggestion: This suggestion to "translate"/transform the speaking ranges DOWN into the ranges that you can actually hear is a great one. So you'd be looking/asking claude for software that would take any/all microphone input at normal speaking frequencies, and in real time, shift/adjust the frequency Downwards until the average speaking midpoint was below 70Hz . then if your brain can hear differences in the lower frequencies, it would just be a matter of training/learning them in those lower frequencies. It may still take some time to hear specific speech, but you need to get it into a range that you can actually detect some changes.
An audio recording or mixing technician may be able to help with suggestions about which frequencies usually contain male, female, child voices and things like "s" sounds or sharper hisses at the end of a sound which tend to be a higher frequency than the main words. But the main goal would be to make ANY speech detectable to your ears.
There may be multiple ways you could try stretching out or reshaping the word sounds
For faster testing, start with a single recorded word at normal ranges. As a starting place, Have a friend record a single word and verify that they can hear it on your computer when it plays (this is important!). Then you would try variations for your software to shift the word into lower and lower frequencies until it becomes legible/hearable to your brain. Once you are able to hear something then record the range that its shifting down into as the "sweet spot". Try a few alternatives above and below that spot to try to find your " best" hearing frequencies. Once you've done that, you'll just need to play that word over and over again until you are able to hear the edges of it, the articulation of the syllables which should sound like hills and valleys. In most languages including English and Korean, The beginnings and the ending sounds (and how abruptly they stop or start), like edges to a sword (wielded by an expert swordsman), or like the movements of a dance (sometimes a slow smooth movement, sometimes an abrupt stop, then movement again). Thise are the same kinds of things we do with our voices to make sounds. A shape of the syllable like a body dancing shape, the lights come up on the stage, then movement(air&vibration) starts in a certain way, then movement (fast or slow) into another mouth shape. Usually the beginning and middle are particularly important, many dialects and creoles tend to drop or slur the ends of words, since if you have already heard the beginning and middle of the word so many times, then you already know the end part. Similarly, if you watch your favorite dance or ballet over and over again, you remember and can know the shape of the body in the next beat before the dancer gets there.
Best of luck on this, please report back if you make any progress, we are all cheering for you, and we hope you're able to make progress!
Reminder: to retrain your brain on different inputs takes time. Make sure you can hear something in the changes, but then when you're in the "sweet spot" range, give it time. Listen hard! Be a learner and always be expecting for that dancers shape to come through. Spend time doing it every day, maybe with a blindfold so that you can focus ONLY on the sounds, otherwise your smart brain will try to work around it, picking cues from visuals.
I've never thought of trying that approach before. It's definitely worth giving a try on my day off. Thank you for the great idea.
Thank you for sharing this. It is all very interesting, and I hope you are able to find out more and experience even more sounds with your implants you do. I would be very interested in being able to experience the tests myself. There are a lot of descriptions of what is being done with the audio, but I have no real intuition as to what any of it actually means. The github repo seems to only have the data in it, and not the tests themselves. Though I could certainly be missing them as well. Including the tracks, or code used the generate the tracks, would be nice.
Thank you so much for your kind words and for taking a close look at the repo. You’re right, it currently only contains the data, not the tests or the tracks themselves. I’m really sorry about that. I work a full-time job, so I can’t upload them right away, but I will add the test tracks and the code used to generate them later.
This was beautiful to read. Thank you for writing it! Don’t worry about it reading like slop - your voice comes through very distinctly to me.
You mention a lot of ethics concerns; I am totally uneducated on medical ethics but I think those are pretty important questions. It doesn’t sound like you’ve had a lot of support from this startup.
I might suggest to you that you publish this on a website - GitHub pages comes to mind as something Claude or codex could do for you easily - it would let you segment this information in a way that someone who wanted to help with the medical questions could get right to that stuff, and someone who wanted to help with ethics could also jump to what they were interested in.
Either way, thank you for the write up! Your curious and open attitude is lovely.
I don't do programming myself, but I'll look into GitHub Pages. I'm deeply grateful for your advice. I've been making clear and repeated requests to the startup, but for some reason, they haven't accepted them for a whole year, and I honestly feel so sad about it.
Have you tried listening to chiptune, MIDI, or electronica music? I am congenitally hearing-impaired myself and also enjoyed Vocaloid, although I had never wondered about a connection before. I've sometimes thought that when Vocaloid producers don't try for realism but go for simpler easier 'purer' Vocaloid voices, it sounded like chiptune/MIDI/electronic. So those might be an interesting musical control group.
I haven't listened to much chiptune, MIDI, or electronica, so I'm not very familiar with them. But after hearing about your experience, I think I should look them up and give them a listen. Thank you for the great suggestion.
I'm glad to hear you discuss listening to music. There's no doubt it will sound different to you, but still well worth enjoying. My best wishes to you for an interesting, and I hope exciting time in your life.
Thank you so much. Speech sounds muffled and blurry to me, but music always sounds so beautiful and lovely. It truly is beautiful. I hope you also have many happy moments listening to beautiful music.
This did not read like slop and was fascinating to look through. I hope you and the ENT doctor in the thread can have a nice conversation after this.
Thank you, I really appreciate your comment. I've never really studied English, so I needed help from an AI translator. Because of that, I was very worried even before posting. Thank you for your encouragement.
This is interesting and I'm going to write out my thoughts for you here. Just some impressions.
Right off the bat after skimming this I'm caught up with a detail that you confirm multiple times - that you can tell literally nothing apart given any input over 70 hz. You have had this measured a few times and you definitely say that nothing is coming across above 70 hz.
Yet you are trying to hear all sorts of things that have most all of their information content above 70hz.
The Hatsune Miku music? You're hearing the bass and the kick drums and maybe some subharmonics generated in the reverberation of the higher stuff. But that is a tiny fraction of the music, and, I hate to tell you this, but that computer girl singing is all way, waaay up higher than 70hz. The beautiful sounds you are getting across are the cool synth basses of all that music. It's very modern, punchy music and the bass of that type of electronic music is very different from other classical music so whatever modulation your implants are doing to it from 70 hz down likely sounds very cool compared to a lot of other music, for sure.
But, stop- you're getting nothing by noise and wind sounds with no information differentiation over 70hz because your brain isn't demodulating that information, maybe due to something about how the implant was... implanted... or just your specific condition, who knows, but what you can do is work in the band you have.
You mention not getting human voices because the fundamentals of human voices are more than 2x where your cutoff is.
Have you tried using a program like Audacity - or - Get claude to write a script for you that takes in MP3's of modern music and slows them down 300-400 %. The music will be very slow, but it will shift instruments from higher up (pianos, horns, people's signing) down into the 20-70 hz range, and you will maybe hear patterns that are new. Did no one in the study post-op sit with you and go thru this kind of thing? You have all these external trials listed but most all of it is moot if everything above 70hz is missing and you aren't able to modify the modulator hardware.
Note that the type of rhythms in the bass of the bass synthesizers of that Hatsune Miku tracks are different that the more complex rhythms and melodies played by instruments higher up (like pianos and lead synths). (This is true for most all music genres...) Shifting those higher up things down in frequency, even if that means they play back slower, may give you an different musical experience.
Continuously pegging your implant modulation hardware with frequency content above 70hz attempting to discover something about how it interacts with your brain when you continuously get nothing but broadband noise over 70hz seems like a dead end exercise.
I mean hell, have you tried putting a low pass filter to block out on everything in the music/microphone input above 70hz just to make sure that information isn't somehow overloading the way the implant works with your brain, and maybe just causing confusion.
Lastly it sounds like you could benefit from talking with someone with a real audio / digital signals processing / electrical engineering background that can inspect your hardware directly and make suggestions because educating yourself with just GPT runs might be spinning you in circles.
For instance... you mention things like " The logic of my test apps, which generate the test sounds and move the staircases, was checked with the Lean 4 formal verifier,"
Man... this has nothing to do with needing a 'Lean 4 formal verifier' to check your app or whatever. You need someone to sit with you and your damn hardware and work with some audio input. You need the someone that setup the original implant modular to explain the hardware mapping and filtering options to you and see if you can go back and change how that works, to get more options. You're getting some wildly mixed signals (bad pun) about how all this works, I think.
> Have you tried using a program like Audacity - or - Get claude to write a script for you that takes in MP3's of modern music and slows them down 300-400 %. The music will be very slow, but it will shift instruments from higher up (pianos, horns, people's signing) down into the 20-70 hz range, and you will maybe hear patterns that are new
You don't need to slow them down, you can just pitch shift everything into the 0-70 hz range. If there were a way to figure out how his brain is demodulating the signal, you might even get something pretty reasonable out - the essay describes sounds like cars as hissy rather than heavy.
The real difficulty is keeping genuinely inaudible frequencies (<40 hz? but who knows how his implant works) from swamping the rest, I would think.
I didn't mention just pitch shifting alone without speed change as depending on how that is done it can introduce artifacts. So just slowing things down like an oldschool tape player is the most 'pure'.
Any computer sound card will high-pass anything over about 16-18 hz and thus new lower stuff won't swamp, and it seems like his implant amplifier does indeed deal with low frequencies because he mentions using an 18hz tone to keep the device key'ed on.
Another thing then to mention would be 'binning' audio that has been pitch shifted own using notch filters / comb filters. Because it is possible that however the implant is wired could use some band gaps to help his brain 'decode' things more clearly and less muddy.
Again, all this is simple shit and I find it really surprising that there isn't someone to help run these tests on hardware with this person, and their blog post here has this very strange rabbit hole feel to it and I can't tell if it is because there is a lot lost in translation, or if there is a lot more to this that is coming across in translation... or if this person in being led down some near-AI-psycosis and is struggling because they simply don't have someone to sit with that can help.
It all comes off to me as very, very strange.
I think there's a misreading at the root of this. The "70 Hz" in the post is the modulation rate from the TMTF, not an audio frequency. The TMTF measures how fast loudness can flutter before the flutter is undetectable. It isn't a pitch or discrimination test. From the post, OP does discriminate, somewhat, above 70 Hz and says they can't judge pitch direction at all, so there is no 20–70 Hz "working band" to retreat into.
I agree with the broader instinct that OP deserves a clinician to help with the hardware side (having their map and device parameters alone would go a long way), but it seems OP is taking any step they can towards this effort.
I regret that I don't have anything to actually add towards helping OP. Their posture towards understanding is refreshing and the Lean bit reads to me more as a cute testament to that than anything eerie or strange.
I re-read it and looking more at the tests and... I think you're right but also maybe OP is confused about how the audio spectrum works in general then, because they themselves talk about this 70hz shelf in the same breath as human vocal ranges etc -- that isn't amplitude modulation frequency. But maybe there is just something here that is lost in translation or I'm just not getting the real purpose of these test measurements.
If I'm a bit more imaginative on this 2nd read of their 'experience' of these tests it seems that maybe yes, they hear 'something' at higher frequencies but it just just broadband noise- broadband noise mind you, is, all frequencies... so I was confused at how someone could say they 'don't hear anything above 70hz' and yet can somehow hear 'noise' at '2000 hz'. But it is dawning on me that the implant / associated driver hardware may simply be 'saturating' when the spectral content of audio is too large at all those frequencies, and OP can actually 'hear' something, but it just blurs into white noise when the spectral power is too high - kinda like there is a massive amount of reverb being applied to everything over 70hz.
But again they talk about their struggles with understanding voices and whatnot but if they are hearing parts of music at all then they could be hearing people' voices shifted into bands and toned down to amplitudes that helps them. Like, clinicians with experience here should be helping with this and it is kinda insane that this person is attempting to discern anything themselves.
The exposition is strange and again that could just be the translation and writing style but some of those little bits and just the way I've seen some people literally start spiraling when they start to pair-autodiadict with AI - coupled with the fact this is a medical condition and a life-altering disability - along with a few other small oddities in this post - make me kinda worried there is a lot more to this than posted and OP may need other kinds of help with their situation.
> ... maybe OP is confused about how the audio spectrum works in general then, because they themselves talk about this 70hz shelf in the same breath as human vocal ranges etc -- that isn't amplitude modulation frequency.
In a CI, voice pitch actually _does_ arrive as amplitude modulation at the F0 rate. The processor keeps only each channel's envelope, and the harmonics of a voice that share a channel beat against each other at F0. So a 70 Hz flutter ceiling and vocal ranges do belong in the same breath.
> ... so I was confused at how someone could say they 'don't hear anything above 70hz' and yet can somehow hear 'noise' at '2000 hz'. But it is dawning on me that the implant / associated driver hardware may simply be 'saturating' ...
The TMTF carrier was noise by design, so above 70 Hz the flutter vanished and the noise that was already there is all that's left. No saturation is needed to explain it. The “wind” in SRD is what a spectral ripple sounds like through limited spectral resolution. This is a resolution problem, not a level problem.
> The exposition is strange and again that could just be the translation and writing style...
This paragraph was why I initially made a comment. They were radically honest with their methodology and obviously living inside the problem. OP is actually reading this thread, for what it's worth.
Sorry, but what is the point of using an LLM to generate replies like this?
What is the point of using your account to generate replies like this? Even your use of "Sorry" is obviously vapid. Try addressing my comment or don't participate.
Thank you for pointing out that the 70 Hz is a modulation rate, not an audio frequency. That's exactly right. I wish I could find someone in Korea to help me with the hardware side, but no matter how hard I've tried to persuade people, I've mostly been ignored. As for the Lean part, I wasn't sure whether it was really necessary. I've never been part of academia, so I'm still very clumsy and amateurish at this. Even so, I'll keep doing my best to find someone who can help with the hardware side. Thank you for your kind words.
That is definitely the weirdest part to me. It is supposed to be a trial for this new implant right? So why isn't the company actually working with them on it? Like how is just telling someone do more therapy acceptable here? Studying their brain's reactions to the stimulus the implant is actually generating seems like something that should have already been done.
I would think you could take the audio processor out of the loop and run diagnostics on the implant itself using an EEG to determine how the brain is responding. They test the hearing of newborns with the tech, you don't need to "trust" a person or even need them to be able to communicate. Its right there in the data.
Based on my read of everything it feels like there is some issue with the implant sending electrical signals, but the nerve not actually picking them up and sending them on. Perhaps related to the original reason for the hearing loss. And the company should want to dig info it more. I know I would if it were my tech.
I pleaded with the cochlear implant company to do research, telling them I desperately wanted to know exactly how I hear, but unfortunately, the only answer I got was that it would be difficult. It makes me feel so sad and helpless.
I was tired yesterday, and I have very little experience writing, so I fully respect the criticism that the post feels messy and strange. I think some parts were accidentally lost in the translation process. As you said, I don't have a single person around me who can help with this, so I've been relying on AI. But I'm consciously keeping myself grounded so that I don't fall into anything like AI psychosis. I'm sorry that the post wasn't better written.
I think the presentation of the whole situation was just a bit jarring to me because it is a wild combination of topic (the hearing implant) coupled with the fact you had to translate (can always be difficult with such a technical topic) while using AI to summarize and edit your entire investigation, published as a Claude artifact - we're really seeing a new kind of blogging here, and that for sure caught me off guard.
I see your situation more clearly after re-reading and also seeing your new responses here in these threads.
I think if you write more on this topic, especially more about your history of hearing and what you can in fact perceive, and publish more on the internet, you will find people who are very interested in this kind of topic - it is something that will 'nerd snipe' many tech minded people - and I am sure you could absolutely make friends in Korea who are interested to help. Having someone with an audiology background, or even a student in neurology who knows their way around audio signals processing / has a DSP / EE background etc. sit in with you for some experiments as you use the line input for you device - someone who also hears what the input is, and can talk with you about it - would be invaluable and could also be a fun social connection- maybe university students, etc. If I spoke Korean and lived in your city I would definitely find it fascinating to try and help out.
Thank you, this is something I'm learning for the first time in my life. I think I should definitely try it on my day off.
Yeah, ordinary hearing is normally quoted as 20Hz to 20kHz, but most people are hearing mostly between 2000 to 5000Hz. If truly there was no perception above 70Hz that would lead to a very muddy and indistinguishable soundscape.
Wikipedia is not bad on the subject: https://en.wikipedia.org/wiki/Hearing_range
> most people are hearing mostly between 2000 to 5000Hz
That's pretty misleading, we tend to have excellent hearing anywhere in the 100 hz - 6000 hz range. Much of music and all fundamental frequencies produced by the human voice (except people with very rare whistle register abilities) is below 2000 hz. We're most sensitive to the range you're talking about because it's the most useful for discriminating between different sounds, but still only slightly more sensitive to that range than to lower frequencies.
I understood that they are able to hear pure base tones at higher frequencies. But once they are modulated quicker than 70 Hz (implant electrodes are switched more quickly than that) then it turns into white noise. That would fit with the "all voices are the same" description where everything is reduced to base frequency, without harmonics.
I would also be very curious about taking the music, and slicing it into different frequency ranges. And playing each of the ranges independently. A tone on its own may be perceived differently than a wider range of frequencies combined. Especially when there is a black box audio processor in the middle. Perhaps it is filtering out those consistent tones in some way to minimize the "noise" and keep just what it thinks is the signal. Like built in noise canceling headphones.
I also think there are some relatively cheap options for getting or building a simple EEG. At least in the US, I don't know about Korea. Which could allow for some more interesting tests. Let it play various sounds and tones while recording with no visual stimulus to go with it, and see how they correspond to the EEG data.
You should just frequency shift, not slow things down. Maintaining a train of thought trying to understand what someone is saying becomes very difficult when it is slowed down.
Wow what a thorough analysis, thanks! Admittedly, I'm not sure how to translate the numbers to audio. AI helped me find these websites:
https://hzgenerator.com/sweep-generator
https://onlinetonegenerator.com/frequency-sweep-generator.ht...
A looping 10 to 70 Hz sweep got the best result with my 20+ year old Apple sound sticks because they have a subwoofer.
With typical hearing, it sounds like almost a dozen distinct frequencies to me. Higher frequencies are just a matter of degree, they aren't qualitatively different IMHO. But I'm not musically inclined, and only have synesthesia when I sort of see color in various gray patterns on the computer screen, which look more blue or whatever sometimes, so I'm sure someone will disagree with me because they sense feelings in audio that I don't.
I'd bet that improvements in technology over the next few years (especially with the help of AI) might get the upper end to perhaps 100 Hz or more, where it begins to sound more like a tone than a hum. Loosely, a beat (like a drum) sounds like perhaps 10 to 20 Hz. A hum sounds like 60 Hz (like electricity). Also I wonder if a cochlear implant can hear below 10 Hz because it's electrical stimulation instead of physical, to maybe hear frequencies that typical hearing can't? But I don't know.
I'm fascinated by this stuff, because sometime in the next 5-10 years we'll get direct digital signal to nerve implants. That could allow people to hear above 20 kHz (like a dog) or even restore smell in people who have had it diminished due to illness or injury.
Many people can see ultraviolet light after getting cataract surgery, which supposedly looks like a blacklight but more blue because there is a little rise in the red visual receptor the overlaps blue to make violet. So technically the blue receptor ends up being a violet receptor because red isn't removed normally. Which means that violet and purple are different colors, because the visual cortex makes sense of them differently at opposite ends of the spectrum based on how much green is present. Of course all of those distinctions may go away when someday the visual nerves can be stimulated directly with an implant and make color more of a continuous spectrum like sound, rather than having distinct color bands like in a rainbow.
Subjectively, I've noticed when I wake up in the morning that the ceiling has grey and yellow splotches, because we have fewer blue receptors in the fovea at the center of the eye, and they haven't adjusted yet. Also at dusk, the rods begin to sense more, so the world fades from color to cyan and then gray. I feel like similar things might happen with audio, because I feel like I can hear better when I'm camping, especially in the morning, but I don't know why.
There are interesting experiments where they put goggles on chickens to flip the world upside down. After 2 weeks, the chickens saw normally again due to neuroplasticity. Then when they took the goggles off, the chickens walked goofy until their brains readjusted.
Also I've read that lion's mane mushrooms regrow neural connections and may even increase neuron synthesis. I've had neurological injuries due living a rough and tumble life that seemed to have healed somewhat after drinking mushroom coffee for a few weeks. Also magic mushrooms scramble nerve connections and let them reestablish themselves, sort of like starting over with a blank slate in neural networks. Mushroom medicine research has been blocked by a century of ignorant legislation, so people have missed out on spiritual healing that strays outside of what science can explain. I think of a brain or neural net as an antenna that resonates with the consciousness field, which is some sort of 5D-like field that transcends our normal 4D spacetime (otherwise it would be a frozen crystal with no observer or passage of time). When our brains get rewired after learning/trauma/injury/illness/healing, our attention shifts to different things, which alters our subjective experience. Meaning that in a very real sense we perceive the world differently and/or feel like we've shifted to a different (often better) timeline. Plant medicines and spiritual practices may allow changes to subjective experience that science can't yet talk about.
Anyway, not sure what point I'm trying to make here with these breadcrumbs, other than that the future isn't written yet, and in fact there are infinite futures, which I believe free will allows us to choose. So there is always hope and a reason to keep going.
You clearly have the hacker mindset (compliment). I hope your investigations are fruitful, for yourself and others who may learn from your experiences!
Thank you. Your compliment really encourages me. This is something I had always been thinking about, and I feel I was able to make it happen with the help of AI. But I still have a lot to learn, so I welcome criticism too. Even so, your kind words mean a lot to me.
>Those of you who hear the world in three dimensions would know the answer, but am I hearing a flat plane?
You typically should feel sound as a 3d point, it maps roughly to the same sensory system that maps light or touch direction. Loud noise would feel as directional and material as bright sun or strong poke to a head. (Brain does this mapping transparently based on the small difference of time it takes the sound to reach your ears.) Sometimes the sound is not clear, you would either hear from a vague direction or with no direction channel provided from your brain at all.
> the small difference of time it takes the sound to reach your ears.
The science behind Head Related Transform Functions [0] is fascinating, and includes additional tricks. For example, the shaped fleshy bits of your ears modify incoming sound differently depending on the direction, so that the noise from "up and in front" has a signature which differs from "down and behind". There's also a component that comes from sound traveling through your head, where traveling through the front is different than traveling though the back.
I particularly remember this because long ago I had an Aureal A3D [1] sound-card which made great positional sound (over headphones) by simulating HRTFs and sound-reflection off of game-world geometry. Unfortunately they were sued into bankruptcy by Creative, whose EAX technology was much less-impressive.
[0] https://en.wikipedia.org/wiki/Head-related_transfer_function
[1] https://en.wikipedia.org/wiki/Aureal_Semiconductor#A3D
The culture here is pretty split. Honestly, there's a sizeable contingent that will likely flame/flag you for mere use of AI. Try not to take it too hard; they don't represent everyone and I at least thought your post was a valuable addition here.
[flagged]
Please don't take HN threads on generic tangents [1] and especially not snarky ones. This isn't a response to the article - it's simply repeating a pre-existing association to a recognized name.
We're trying for more interesting conversation here and that requires specifics, not generics.
Another way of putting this is that we want reflective comments rather than reflexive ones [2].
[1] https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...
[2] https://hn.algolia.com/?dateRange=all&page=0&prefix=true&sor....
While you're at it: a couple of the OP's comments in this thread have been flagged and are now dead, which really is a shame.
Most probably they got classified as genai. Looks like users have vouched for them all now.
Can't say I've had better experiences with GE appliances but their jet engines seem fine.
I also can't imagine what you thought this comment was contributing to the conversation but that's not my problem I guess.
Agreed on all points, and I'd like to point out that most GE appliances aren't actually made by GE. They're essentially selling their name to a manufacturer. Wouldn't be surprised if Samsung is the same.
Frankly a dumb move since it tarnishes their brands, but.. profits?