• 3 Posts
  • 1.22K Comments
Joined 2 years ago
cake
Cake day: September 24th, 2023

help-circle

  • I think we still must call this an “open question”.

    Not sure I agree. I do think you’re right - it’s hard to prove these things because it’s fundamentally hard to prove things involving people, and also because most of the advantages of static types are irrelevant for tiny programs which is what many studies use.

    But I don’t think that means you can’t use your judgement about it and come to a conclusion. Especially with languages like Python and Typescript that allow an any cop-out, it’s hard to see how anyone could really conclude that they aren’t better.

    Here’s another example I came across recently: should bitwise & have lower precedence than == like it does in C? Experience has told us that the answer is definitely no, and virtually every modern language puts them the other way around. Is it an open question? No. Did anyone prove this? Also no.



  • Just being open source doesn’t guarantee a project’s survival. If Google were to abandon it the most likely outcome would be a community fork that gets 100th of the development manpower it gets now, and most developers would abandon the platform leading to it’s effective death.

    But I also think it’s unlikely Google will abandon it. It’s actually quite good and quite popular now.


  • Definitely a high usefulness-to-complexity ratio. But IMO the core advantage of Make is that most people already know it and have it installed (except on Windows).

    By the time you need something complex enough that Make can’t handle it (e.g. if you get into recursive Make) then you’re better off using something like Bazel or Buck2 which also solves a bunch of other builds system problems (missing dependencies, early cut-off, remote builds, etc.).

    However this does sound very useful for wrangling lots of other broken build systems - I can totally see why Buildroot are looking at it.

    I recently tried to create a basic Linux system from scratch (OpenSBI + Linux + Busybox + …) which is basically what Buildroot does, and it’s a right pain because there are dependencies between different build systems, some of them don’t actually rebuild properly when dependencies change (cough OpenSBI)… This feels like it could cajole them into something that actually works.






  • Private or obscure ones I guess.

    Real-world (macro) benchmarks are at least harder to game, e.g. how long does it take to launch chrome and open Gmail? That’s actually a useful task so if you speed it up, great!

    Also these benchmarks are particularly easy to game because it’s the actual benchmark itself that gets gamed (i.e. the code for each language); not the thing you are trying to measure with the benchmark (the compilers). Usually the benchmark is fixed and it’s the targets that contort themselves to it, which is at least a little harder.

    For example some of the benchmarks for language X literally just call into C libraries to do the work.



  • It has no memory, for one.

    It has very short term memory in the form of it’s token context. Especially with something like Meta’s Coconut.

    What makes you think that it does know its in a conversation?

    I don’t really. Yet. But I also don’t think that it is fundamentally impossible for LLMs to think, like you seem to. I also don’t think the definition of the word “think” is so narrow that it requires that level of self-awareness. Do you think a mouse is really aware it is a mouse? What about a spider?




  • And how do you know LLMs can’t tell that they are involved in a conversation?

    Unless you think there is something non-computational in the human brain, then you must accept that computers are - in theory - capable of thinking. With the right software and sufficiently powerful hardware.

    Given that truth (which I think you can only avoid through religion or quantum quackery), you can’t just say “it’s only maths; it can’t be thinking” because we know that maths can think.

    Do LLMs “think”? The definition of “think” is wooly enough and we understand them little enough that it’s quite an assertion to say that they definitely don’t.