Uncommon Descent Serving The Intelligent Design Community

How to Lose a Wittgensteinian Battle

Share
Facebook
Twitter
LinkedIn
Flipboard
Print
Email

Philosophy is a battle against the bewitchment of our intelligence by means of language.

Ludwig Wittgenstein, 1953, aphorism 109

My recent exchanges with Jeffrey Shallit illustrate this aphorism. Our disagreement is not over the substance of the matter. Instead, our disagreement hinges on Shallit’s abuse of language to make a trivial point. Shallit and I disagreed over whether an excerpt from Hamlet’s soliloquy could be considered “random” in any meaningful sense of that word. In the course of that exchange Shallit said this:

Barry, and all ID advocates, need to understand one basic point. It’s one that Wesley Elsberry and I have been harping about for years. Here it is: the opposite of ‘random’ is not ‘designed’.

The problem with Shallit’s assertion is that neither he nor Wesley Elsberry get to decide what “random” means. In linguistic theory words acquire meaning in a language by convention among the speakers of that language, not by diktat, and as I will demonstrate below, in the English language “random” does in fact mean the opposite of “design.”

In order to determine whether “random” is the opposite of “design” we must first establish what those two words mean. Wikipedia defines “random” as follows:

Randomness means lack of pattern or predictability in events. Randomness suggests a non-order or non-coherence in a sequence of symbols or steps, such that there is no intelligible pattern or combination.

Thus, a random string of text is one in which there is no intelligible order, coherence, or pattern.

Webster’s Dictionary defines “design” as follows:

1. to prepare the preliminary sketch or the plans for (a work to be executed), especially to plan the form and structure of;
2. to plan and fashion artistically or skillfully;
3. to intend for a definite purpose;

Any string of text that results from “design” will definitely have an intelligible order or pattern.

Therefore, Shallit is wrong. “Random” is in fact the opposite of “designed.”

Shallit insists, however, that Hamlet is in fact “random” as that term is used in algorithmic information theory. For what he means by this, Wikipedia again:

Algorithmic information theory studies, among other topics, what constitutes a random sequence. The central idea is that a string of bits is random if and only if it is shorter than any computer program that can produce that string (Kolmogorov randomness)—this means that random strings are those that cannot be compressed.

In his first post Shallit ran both a string of keyboard banging gibberish and Hamlet through a computer program,

If we want to test this [i.e. randomness] in a quantitative sense, we can use a lossless compression scheme such as gzip, an implementation of Lempel-Ziv. A truly random file will not be significantly compressible, with very very high probability. So a good test of randomness is simply to attempt to compress the file and see if it is roughly the same size as the original. The larger the produced file, the more random the original string was.

Here are the results. String #1 is of length 502, using the ‘wc’ program. (This also counts characters like the carriage returns separating the lines.) String #2 is of length 545.

Using gzip on Darwin OS on my Mac, I get the following results: string #1 compresses to a file of size 308 and string #2 compresses to a file of size 367. String #2’s compressed version is bigger and therefore more random than string #1: exactly the opposite of what Arrington implied!

What is going on here? Despite the facetious title of my third post Shallit is not barking mad. Nor is he stupid. Why on earth would an obviously intelligent person write a sentence like “[Hamlet’s] compressed version is bigger and therefore more random than [gibberish]”?

Please see the Wittgenstein quotation above. The simple and obvious fact of the matter is that the string from Hamlet does not conform to the English word “random” to even the slightest degree. The string was carefully designed. Therefore, it has zero randomness. Hence, it cannot be “more random” than any string of text that displays any randomness whatsoever. Certainly it cannot be “more random” than a string of gibberish. But in his eagerness to discredit my analysis, Shallit lost sight of that fact. In short, he lost the battle against the bewitchment of his intelligence by means of language.

Sure, the compressed version of Hamlet is bigger than the compressed version of gibberish. And if one insists on defining relative randomness in terms of relative compressibility Hamlet is “more random.” Here’s the problem with that approach. It is glaringly obvious that Hamlet is not in any degree “random” whatsoever as that word is used by English speakers. Therefore, by its very nature it is not subject to a relative randomness analysis except to the extent one observes that it is totally non-random and any string that is even partially random is therefore more random. So what did Shallit accomplish when he insisted that under his esoteric definition of “random” Hamlet is “more random” than gibberish? He made a trivial mathematical point, and in the process made himself look foolish.

My advice to Shallit. Next time you are fighting Wittgenstein’s battle against the bewitchment of your intelligence by means of language, fight harder.

Comments
Steno, Take the scenario outlined @89 above, but let's make a small alteration. Let's suppose the cards are being shuffled and dealt by a black box. 1) How many hands would you play where your opponent is getting dealt a Royal Flush every time before you would start to infer that the system is not random? 2) Can you walk me through how you would make that inference?Phinehas
October 10, 2014
October
10
Oct
10
10
2014
04:06 PM
4
04
06
PM
PDT
BA:
What purpose is served by concluding that Hamlet is “more random” than gibberish?
1) AFAIK has no one claimed that Hamlet is “more random” than gibberish, but I subscirbe to J. Shallits observations:
"Ultimately, the answer is that it is completely reasonable to believe that neither of Barry's two strings is "random" in the sense of likely to have been generated randomly and uniformly from a given universe of symbols. "
and
"For mathematicians and computer scientists, complexity of a string can be measured as the size of the optimal compressed version of that string. Again, we don't have a way to determine Kolmogorov complexity, so in practice one can use a lossless compression scheme as we did above. The larger the compressed result, the more complex the original string. And the results are clear: string #1 is, as measured by gzip, somewhat less complex than string #2."
2) One of the purposes served by this exercise is to show how bad humans are as random number generators - something, the guys at Bletchley Park found out in the 1930s/1940s! 3) Let me repeat my question:
B. Arrington, what’s your take: is “4ad9;SdaodDajdjad9;Sdjfijdvsdjf;dHJ;sjvaD5…” gibberish or is it Hamlet – or something else?
DiEb
October 10, 2014
October
10
Oct
10
10
2014
03:57 PM
3
03
57
PM
PDT
MF:
He was quite clear and open about his definition.
OK. In my Poker game illustration, the same could be said of Shallit's clarity and transparency. That hardly demonstrates that his answer to your challenge regarding his card dealing was responsive or germane, does it?
To me this was an interesting and counter-intuitive result...
Again, OK? One supposes you would have been similarly interested and surprised by Shallit's revelation about KC in the Poker game context. Personally, I would have accused him of having lost the plot. Or perhaps deliberately misunderstanding what I meant in questioning whether his shuffling and dealing technique was as random as it ought to be. Shallit ought to know that, while any specific hand is just as improbable as any other, the probability of getting five random cards is exceptionally high where no cheating is involved. Thus, pointing out the improbability of your hand after the fact would be to miss the point. Similarly, Shallit ought to know that the compressibility of gibberish isn't really being addressed by running gzip on a specific instance of gibberish after the fact of its generation. As Tim pointed out, gibberish can be compressed to the shortest program that can spit out any gibberish, not the shortest program that can replicate a specific instance of gibberish.Phinehas
October 10, 2014
October
10
Oct
10
10
2014
03:56 PM
3
03
56
PM
PDT
For our readers who are not fluent in Darwinese, I will translate Mark Frank's response @ 97. Roughly, in plain English, it means:
I've got nothing.
Barry Arrington
October 10, 2014
October
10
Oct
10
10
2014
03:08 PM
3
03
08
PM
PDT
#92 BA
What purpose is served by concluding that Hamlet is “more random” than gibberish?
I am sorry I didn't notice the question earlier. Obviously KC as a measure of randomness has many uses in information theory. It is rather interesting to see that a string that appears as gibberish to us is actually less random than a quote from Hamlet according to this measure. Appearances can be deceptive. It also casts doubts on Dembski's efforts to get away from a need for an external standard when deciding when a string is specified. But please I only wanted to pick up on the abuse of Wittgenstein. I think the randomness thing has been done to death and I should never have got back into it.Mark Frank
October 10, 2014
October
10
Oct
10
10
2014
12:02 PM
12
12
02
PM
PDT
Steno @ 95. "maybe it would help" Help what? Would it help to make the statement "Hamlet is more random than gibberish" meaningful instead of meaningless? No, it would not.Barry Arrington
October 10, 2014
October
10
Oct
10
10
2014
11:59 AM
11
11
59
AM
PDT
Barry, maybe it would help if you would remind us of the original argument you used when you first presented the two strings of characters. If my memory goes that far back it was that the Hamlet string is obviously designed and the other one isn't; as a metaphor for demonstrating how you can detect design in nature. Am I correct? If so, you failed. The only way that we know that the Hamlet string was designed is because...we know it was designed. But if we don't know that in advance, there is no objective measure that would demonstrate this. The same argument can be used for ID. We can only identify design if we presuppose that there is design. I am pretty sure that there is a term for that. Please help me out. Does anybody know what it is?..,,,,oh yah! A circular argument.stenosemella
October 10, 2014
October
10
Oct
10
10
2014
11:54 AM
11
11
54
AM
PDT
No, steno, my problem with the statement “Hamlet is more random than gibberish” is that it is utterly meaningless and has no application to the real world. In the real world Hamlet is not random in even the slightest degree. Therefore, saying that Hamlet is “more random” than gibberish is absurd and has no application to the real world. Therefore, to the extent a particular mathematical approach has lead Shallit to a conclusion that is at odds with the real world, the problem is with the application of the mathematical approach in an area where it fails. I have admitted all along that the use of KC could lead one to conclude that Hamlet is more random than gibberish. That does not make Hamlet more random than gibberish. Instead, it points to the attempted application of KC in an area where the results of the method lead to error. Why is that so difficult to understand?Barry Arrington
October 10, 2014
October
10
Oct
10
10
2014
11:48 AM
11
11
48
AM
PDT
"Why do you guys have such a problem with accepting that the word “random” may have multiple meanings?" I think that their problem is with the fact that science only has one definition of random. And it is not the one that Barry (ID is science) is using. Retroactively.stenosemella
October 10, 2014
October
10
Oct
10
10
2014
11:39 AM
11
11
39
AM
PDT
Mark, you have never responded to my question: What purpose is served by concluding that Hamlet is "more random" than gibberish?Barry Arrington
October 10, 2014
October
10
Oct
10
10
2014
11:37 AM
11
11
37
AM
PDT
#89 Phineas I now have some idea of what you are getting at. The Hamlet sequence is more meaningful to people than the other sequence. This indeed is one meaning that is attached to the word "random" and the Hamlet quote would clearly be less random than string 1 according to this definition. It is not the definition Shallit was using. He was quite clear and open about his definition. He didn't make it up for the occasion. It is widely used and accepted, among other things in information theory (if you don't believe me do a bit of googling on Kolmogorov Complexity), and it is one that William Dembski uses a lot. According to this definition string 1 is almost certainly less random than the Hamlet sequence (as I understand it, the compression utility does not absolutely prove that string1 has a greater KC compression but it is a strong indicator). The reason is that while string 1 may mean less to us, it was generated by a process which makes it far from random e.g the many repeated sequences of characters. To me this was an interesting and counter-intuitive result which follows from this particular important sense of random. To Barry it appears to be something akin to heresy. Why do you guys have such a problem with accepting that the word "random" may have multiple meanings?Mark Frank
October 10, 2014
October
10
Oct
10
10
2014
11:31 AM
11
11
31
AM
PDT
Should read: ...the exact cards in your hand are no LESS improbable than his.Phinehas
October 10, 2014
October
10
Oct
10
10
2014
10:17 AM
10
10
17
AM
PDT
MF:
[W]hat was the point [Shallit] missed[?]
Suppose you and Shallit sit down for a friendly game of Poker. Shallit shuffles and deals the cards. You are dealt: AH 4H QD 8S 8C You make your bets, then Shallit lays down his hand. He has: AS KS QS JS 10S As Shallit reaches for your money, you begin to raise questions about whether his hand was truly random. Shallit points out that the exact cards in your hand are no more improbable than his. Further, using K's compressibility, both are obviously (nearly?) equal in randomness. So, has Shallit missed the point? Has he made a category error? Or do you find his answer completely satisfactory?Phinehas
October 10, 2014
October
10
Oct
10
10
2014
10:15 AM
10
10
15
AM
PDT
Barry. At no point did I insist Wittgenstein would have been OK with that sentence. All I was picking up was the misuse of the famous quote. What his views would have been on this silly dispute I have no idea.Mark Frank
October 10, 2014
October
10
Oct
10
10
2014
08:52 AM
8
08
52
AM
PDT
#86 Phinehas You are going to have to expand on that. Please point to the sentences Shallit wrote that were a category mistake. Also what was the point he missed.Mark Frank
October 10, 2014
October
10
Oct
10
10
2014
08:34 AM
8
08
34
AM
PDT
MF:
All he was doing was comparing the KC compression of two strings...
That's not all he was doing. He was also entirely missing the point. He was making a category mistake. It's basically the same kind of category mistake that one makes when insisting that a random hand of five cards is highly improbably by using the specification of the already drawn random hand to calculate probability. It's a newbie mistake, and you and he ought to know better by now.Phinehas
October 10, 2014
October
10
Oct
10
10
2014
08:09 AM
8
08
09
AM
PDT
Phineas #82   I guess I am more interested in Wittgenstein ... but as it is nearly the weekend …..   I didn’t pick up no Tim’s #7 because I couldn’t see what he was getting at.  He wrote:
When Barry sat down to type out the gibberish, he didn’t really have to land on the gibberish that we all saw in the previous OP, so why did Shallit run that particular string for K’s compressibility?
Shouldn’t he [Shallit] have produced a code for writing gibberish of a similar length as the soliloquy then checked that new code’s (compressed) length against that of the soliloquy?
There is no reason why Shallit should have done  this. All he was doing was comparing the KC compression of two strings and happening to note that, rather surprisingly perhaps, the sequence from Hamlet appeared to be more random (using a widely acknowledged, if technical, definition of random) than the sequence generated by Barry tapping “haphazardly” at the keyboard. It is quite possible that other strings generated by similar methods would be less random than Hamlet. So what?
I asked MF for clarification on what just seems to be such an obvious smuggling of specification, but he didn’t seem to understand my question, what am I missing here?
I still don’t understand the question. What has all this got to do with specification? I thought the OP was about definitions of “random”.Mark Frank
October 10, 2014
October
10
Oct
10
10
2014
07:50 AM
7
07
50
AM
PDT
For the last time, “[Hamlet] is more random than [gibberish]” is exactly the kind of meaningless statement Wittgenstein had in mind. Mark is insisting that Wittgenstein would have been OK with that sentence if he understood that Shallit was using an esoteric mathematical definition such that “more random” did not mean “more random” but “more compressible using a computer program.” Nonsense.Barry Arrington
October 10, 2014
October
10
Oct
10
10
2014
07:47 AM
7
07
47
AM
PDT
MF:
I intended to stay out of this debate but when I see Wittgenstein quotes abused I have to respond.
How do you lose a Wittgensteinian battle? Quibble over whether it is Wittgensteinian while avoiding the main points.Phinehas
October 10, 2014
October
10
Oct
10
10
2014
07:42 AM
7
07
42
AM
PDT
MF @80: While I don't doubt you'd rather quibble over Wittgenstein, since you are here and participating anyway, maybe you could address Tim's substantive issue raised as early as @7 in this thread, and even earlier in the previous thread? But perhaps you are too busy for that kind of thing.Phinehas
October 10, 2014
October
10
Oct
10
10
2014
07:28 AM
7
07
28
AM
PDT
ES
Which definition of design detection is it this time? The non-measurable kind?
You might want to read the OP which quotes Shallit.
If we want to test this [i.e. randomness] in a quantitative sense, we can use a lossless compression scheme such as gzip, an implementation of Lempel-Ziv.
If you want to learn about ID, read Dembski and Behe to start - there are dozens more good books on the topic.Silver Asiatic
October 10, 2014
October
10
Oct
10
10
2014
04:27 AM
4
04
27
AM
PDT
Tim #74 So far you failed to produce a single sentence from the PI to support your case. Instead you turn to Wikipedia. I cannot find a single sentence there either. The closest is:
he believed that philosophers had obscured this simplicity by misusing language and by asking meaningless questions.
I think that is a rather poor description. It is more that philosophers are mislead by the structure of ordinary language to ask bizarre questions (see for example para 116 of PI). But anyway it does not refer to technical language. The famous quote Barry used came from para 109. I have already quoted from other parts of the paragraph to support my case but I will expand on it. It is hard to summarise W’s work and point to the section of the PI that deals with a topic because of the structure of the book. However, I am not aware of any section that deals with technical language or disputes about definitions. Famously the book is stuffed with comments about ordinary language and how it can bemuse philosophers. Look for example at his discussion of knowledge in paras 148 to 151 (and the continuation of the discussion from para 179) or the discussion of sensations from 244 onwards. Until you can actually produce some quotes from PI to support your case you have nothing but your assertion that you are right.Mark Frank
October 10, 2014
October
10
Oct
10
10
2014
02:11 AM
2
02
11
AM
PDT
DiEb at #50: It's strange how very simple concepts are so difficult to understand, when one really does not want to understand. Your coded version of Shakespeare is a coded version of Shakespeare. It is designed. It contains the same functional information as the original Shakespeare passage, only in different form. The only difference is that I, as an observer, need to know the code to understand the English meaning. So, is the string designed? Yes. Can design be inferred for it? Yes. How? It's simple. a) If I look at the string, and I know, or just understand from some formal aspect, that it is coded, and I can derive the code, and derive the correct English meaning, I will easily make the design inference for it. It will be an obvious case of true positive design inference. b) Of course, it is perfectly possible that I don't recognize the string as coded, and that I cannot connect it to its English form. In that case, I will not make any design inference for it. It will be a case of false negative. One of the many. Remember, design detection by functional specification is a procedure with absolute specificity (no false positives) and low sensitivity (a lot of false negatives). So, it's very simple: If you want to falsify the concept of design detection by functional specification, you must show some false positive. Showing false negatives does not help. Can you understand that?gpuccio
October 10, 2014
October
10
Oct
10
10
2014
12:04 AM
12
12
04
AM
PDT
Silver Asiatic
Shallit used design detection to recognize the non-random elements in the text and this wss supposedly a victory.
Which definition of design detection is it this time? The non-measurable kind?E.Seigner
October 9, 2014
October
10
Oct
9
09
2014
11:19 PM
11
11
19
PM
PDT
Can you tell I was typing on a smart phone? ID again.Silver Asiatic
October 9, 2014
October
10
Oct
9
09
2014
06:42 PM
6
06
42
PM
PDT
How do you conclude that there is no “rule-base method of encryption”, which maps this string onto something which is obviously not gibberish? How do you decided which strings are gibberish, and which should may be not? Sorry - to finish. Yes, that's a limitation in design detection. You can't prove that a string is not written in a complex unknown code. SETI research may be ignoring hundreds of coded messages. We can only do pattern matching with what is known and look for correlations.
Silver Asiatic
October 9, 2014
October
10
Oct
9
09
2014
06:36 PM
6
06
36
PM
PDT
how do you conclude that Barry’s first string is gibberish? The term “asd” appears 16 times in it, the terms “vioja” three times (ignoring capitalization).
DiEb - Youre chasing afterna point that has been answered already. Shallit used design detection to recognize the non-random elements in the text and this wss supposedly a victory. But he also recognized that "asd" is s common keyboard combination and then drew a design inference (that it was keyboarding". For whatever reason he didnt want to offer truly randomized text instead (and you could do that also). How do you conclude that there is no “rule-base method of encryption”, which maps this string onto something which is obviously not gibberish? How do you decided which strings are gibberish, and which should may be not?Silver Asiatic
October 9, 2014
October
10
Oct
9
09
2014
06:12 PM
6
06
12
PM
PDT
DiEb, why oh why do you persist? Please understand this! Nobody cares about your post at 22. Virtually everybody (probably even Shallit by now) understands that the heart of the matter has nothing to do with Barry's "failure" to be "perfectly" random in string #1. Got it? Nobody. So here is my point, yet again. This is from Phinehas@40
Barry’s gibberish was designed to be gibberish. If this is the case, then it should not be surprising that some hallmarks of design can be found in it if one looks hard enough.* But focusing on patterns found in the gibberish is to miss the point that the string is meant to be representative and not literal. Tim spells this out clearly @7 above, but it appears that detractors are more interested in continuing to miss the point.
I smell troll. Yup, I'm done for this thread; I admit it. I got sucked in. Now, I have troll on me. Yuck.Tim
October 9, 2014
October
10
Oct
9
09
2014
05:25 PM
5
05
25
PM
PDT
MF@64 (and everybody else who cares and has 20 minutes to burn), please read good ol' Wikipedia's article on Philosophical Investigations where you will find that Mark Frank is wrong and I am right. I do have to say that from my place of work (a highly "distract-able" environment) and the cobwebs of over twenty-five years since last visiting Wittgenstein, I was surprisingly accurate. Mark, after you read it, I expect you to take one more step, thank you.Tim
October 9, 2014
October
10
Oct
9
09
2014
05:15 PM
5
05
15
PM
PDT
E.S.:
It’s always the non-IDists doing any actual science here. Noted yet again.
They should go elsewhere to do their science. When they do their science here it makes it seems like they are in fact accepting that ID is science and is capable of a scientific refutation, thus exposing the ignorance of those who claim that ID is not science.Mung
October 9, 2014
October
10
Oct
9
09
2014
05:06 PM
5
05
06
PM
PDT
1 2 3 4 5

Leave a Reply