Hacker Newsnew | past | comments | ask | show | jobs | submit | Nokinside's commentslogin

The first SoC including Neural Engine was the A11 Bionic, used in iPhone 8, 8 Plus and iPhone X, introduced in 2017. Since then, every Apple A-series SoC has included a Neural Engine.


The first SoC including Neural Engine was the A11 Bionic, used in iPhone 8, 8 Plus and iPhone X, introduced in 2017. Since then, every Apple A-series SoC has included a Neural Engine.


The Neural Engine is its own block. Neural Engine is not used for local LLMs on Macs. Neural Engine is optimized for power efficiency while running small models. It's not good for LARGE language models.

This change is strictly adding matmul acceleration into each GPU core where it is being used for LLMs.


The matmul stuff is part of the Neural Accelerator marketing, which is distinct from the Neural Engine you're talking about.

I don't blame you. It's confusing.


It's remaining and rearrangement of the same stuff. Not a new feature.


The NPU is still there. This adds matmul acceleration directly into each GPU core. It takes about ~10% more transistors to add these accelerators into the GPU so it's a significant investment for Apple.


1. It adds new features. Eg. see matmul and other to-be-detailed-soon features.

2. It moves some stuff from the external Neural Engine to the GPU, which substantially increases speeds for those workloads. That itself is a feature.

Will any of this really matter much to the average consumer at this point? Probably not. Not until Apple Intelligence gets off the ground.


That's just start.

The bleeding edge uses abstract interpretation to verify code.

Free from NASA: IKOS (Inference Kernel for Open Static Analyzers) is a static analyzer for C/C++ based on the theory of Abstract Interpretation. https://github.com/NASA-SW-VnV/ikos

Commercial: Astrée is a static analyzer for safety-critical software written or gen­er­ated in C or C++. https://www.absint.com/astree/index.htm https://www.absint.com/astree/index.htm

abstract interpretation for static analysis and verification:

Good intro Mechanized semantics, fifth lecture Abstract art: static analysis by abstract interpretation https://xavierleroy.org/CdF/2019-2020/5.pdf

Static Analysis and Verification of Aerospace Software by Abstract Interpretation https://mine.perso.lip6.fr/publi/article-bertrane-al-fntpl15...


On the free side, you also have Frama-C (https://www.frama-c.com) and its Eva plug-in, based on abstract interpretation, and Mopsa (https://mopsa.lip6.fr), also based on abstract interpretation.


It'll be the same for Intel with their new process node.

Everyone working with the latest process node is tightly coupled with the manufacturer: Nvidia, Apple, AMD, and Qualcomm. Microarchitecture design and optimization for a new process is super expensive and hard.

Legacy processes have settled, have standardized design software and tooling, so everything costs less.

ps. Nvidia and Qualcomm are considering Samsungs 2mm because TSMC's 2-nanometer chip production capacity is extremely limited.


Software verification tools based on abstract Interpretation are really good today.

If you want free software I recommend IKOS - a is a sound static analyzer for C/C++ developed at NASA. Checks: https://github.com/NASA-SW-VnV/ikos/blob/master/analyzer/REA... Numerical abstract domains: https://github.com/NASA-SW-VnV/ikos/blob/master/analyzer/REA...

Commercial tool like Astree https://www.absint.com/astree/index.htm if you have money.


It's common to discover IMSI-catchers in national capitals around the world. There are many interesting targets.

Washington, D.C. mobile traffic is probably the most spied in the world. Especially now when it's run by technological cavemen and overly confident techbros. Israeli, Russians, Chinese, French and everyone.


Back in the mid-80s, it was an open secret that some AMPS transmissions could be received on ordinary TV tuners which were capable up to Channel 83 or so.

My father being a DXer and installer of a home-built Yagi and rotator system, I discovered this fairly easily. All he told me was to just guard the privacy of these people I was snooping on, because they were supposed to be private conversations after all. I never heard anything of substance anyway. It was one of the more boring surveillance activities of my misspent youth.


The Soviet/Russian station in San Francisco was heavily involved in SIGINT back in the days of microwave radio trunks and analog mobile phones, and I would imagine the Chinese have taken the throne from them today.


Few years back suspected Israeli IMSI-catcher was fond in DC https://www.politico.com/story/2019/09/12/israel-white-house...

APNewsBreak: US suspects cellphone spying devices in DC https://apnews.com/general-news-d716aac4ad744b4cae3c6b13dce1...


> least some part of the populace is well armed enough to overthrow t

What a naive fantasy.

Organization of people is much more important than guns. You don't even need guns when you organize. You can stop the state just by collective action. See color revolutions.

When it is guns, you need RGP's, detonators and TNT (and drones), a good underground insurgent logistic chains. You also need commit to life in poverty and eventual death.

United States, Hungary, Turkey, Russia, Serbia have plenty of independent weapons, yet there is no fear of effective armed resistance. Everybody is a rebel in the Internet. When things go tough it's "I have to go to work and eat. My family needs me."


Magna Carta predates not just guns but even just gunpowder being known in Europe.

The barons it talks about would have been somewhat analogous to US state governors, though even then it's a very loose analogy as the logistics of England in the 1200s was so different to the modern world.

There's lots of things it could be analogised to, including a board of directors empowered to remove an unwanted CEO; or how the English civil war was a fight between Charles I and his parliament (some of the discourse at the time explicitly mentioned Magna Carta*).

Which is to say that while one does indeed need to be able to respond "this one" when asked "you and what army?", that requirement is not itself a show-stopper, people can (and have) been able to give the correct answer.

* https://en.wikipedia.org/wiki/Petition_of_Right


> See color revolutions.

Bad example, since they are mostly just clandestine interventions of another state to destabilize the one they are happening in.


It was just a question of time.

Even without spoke-and-hub model, hubs grow and there are more hubs. Airports are the bottleneck. 500 passengers per landing adds capacity.


I belong to the same X-gen group as Marc Andreessen, Curtis Yarvin, Elon Musk,Peter Thiel, and others. I have a background in computers and am financially independent.

While I strongly disagree with them, I feel an affinity and familiarity with their thinking. I have read the same books, seen the same news, and lived in the same era. I understand how they arrived where they are now.

The Neo-reactionary movement seems exactly like what my generation comes up from the right. Dark Psychology of Dark Enlightenment is a cyberpunk sci-fi world as a fantasy. To live with societal collapse, dystopia and decay with low-life and high-tech. Always framing oneself as an independent outsider and a rebel. Sarcasm as a reflex. These guys see themself living in William Gibson's Neuromancer world.


>> While I strongly disagree with them, I feel an affinity and familiarity with their thinking. I have read the same books, seen the same news, and lived in the same era. I understand how they arrived where they are now.

Similar , however I see them more as extreme greed (for power/control) and technological hubris.

Interesting how people interpret things differently based on their life experiences. I feel this is what strong advocates of objective facts and EMH tend to miss. People have the same input data, however the interpretations are different based on the (hidden) internal state.

I keep wondering, what does the richest man in the world want more ? Why this ? I find it a very revolting way to live.


I can see how you would draw this conclusion, and somewhat agree. However, viewed through occam's lens, I'm more inclined to go with simple greed (tale as old as time) over an adult male fantasy.


an awful lot of human history can be reduced to "fuck you, pay me -- or else"


Pretty much the perverted basis of capitalism.


> I belong to the same X-gen group as Marc Andreessen, Curtis Yarvin, Elon Musk,Peter Thiel, and others.

Me too.

> I have a background in computers and am financially independent.

Me too.

I think having read the same books, seen the same movies and news, played similar games, having lived in the same era is only part of it.

Maybe where you came from, where and under what circumstances you grew up, which opportunities and/or (bad)luck you had, where the winds of chaos have blown you, how you were 'driven' to be 'driven' where you landed makes you more detached, or immune to such overgeneralizations, or maybe call it 'cultural' brainwashing?

IOW: There is too much trash in the minds of too many people. Memory leaks. Buffers overflow. Garbage collection is overdue. Or a reboot.

Edit: That's not to be read as an endorsement of the people you mentioned, and their likes. Or that I'd be a fan. Maybe my 'reboot' is useless, too. Because the filesystem is irrecoverably damaged, the hardware underneath has been replaced, and is working different, so a new install of another 'OS' is needed anyways.

Things change faster than tribalistic peoples grasp. Dunbar's Number etc.


They use the whole wafer for a chip (wafer scale). The WSE-3 chip is optimized for sparse linear algebra ops, used 5nm TSMC process.

Their idea is to have 44 GB SRAM per chip. SRAM is _very_expensive_ compared to DRAM (about two orders of magnitude).

It's easy to design larger chip. What determines the price/performance ratio are things like

- performance per chip area.

- yield per chip area.


Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: