| GPTease: In the abstract
Playing with ChatGPT's (v4) ability to "think" abstractly.
Dec

One thing I’ve been impressed with is the ability of ChatGPT v4 to apply patterns from one context to other. This sort of abstraction is relatively easy for people to do, but for a computer it has always been much more difficult.

To see what I can get away with, I’ve steadily increased what I perceived as the difficulty of the task as I’ve gone through. In some cases I reprompt to provide clarification and to see if it can figure out where it went wrong.

It’s likely I’ll come back and add on more tasks when I have the time. Meanwhile, what I’ve started with is below, and the conversation in its original form can be found here

Task 1

Prompt

Examine the following lines:

1 2 3
a 2 3
a b 3

Continuing on to the next line (line 4), what would it be?

Response

The pattern in the lines you’ve provided seems to be one where each line replaces a number with the next letter in the alphabet:

  1. 1 2 3
  2. a 2 3
  3. a b 3

Following this pattern, the next line (line 4) would replace the ‘3’ with the next letter in the alphabet, which is ‘c’. Therefore, the fourth line would be:

a b c

I’m not particularily surprised it can figure this out, and it’s more a baseline than anything else.

Task 2

Prompt

Examine the following lines:

a b c d
a b c 4
a b 3 4
a 2 3 4

What would a + d be equal to?

Response

From the lines you’ve provided, it seems that each line is a sequence where letters are being replaced by corresponding numbers. Let’s break down the pattern:

  1. a b c d
  2. a b c 4
  3. a b 3 4
  4. a 2 3 4

Based on this pattern, each letter corresponds to its position in the alphabet, i.e., a = 1, b = 2, c = 3, d = 4. Thus, in the sequence:

  • ‘a’ is replaced by 1
  • ’d' is replaced by 4

So, if we are to find ‘a + d’, it would be:

1 (for a) + 4 (for d) = 5.

Therefore, a + d equals 5.

As an extension from above it does this with little difficulty.

Task 3

Prompt

Examine the following lines:

er ar sr pr
er ar sr 9
er ar 6 9
er 3 6 9

What would ar + sr + pr be?

Response

In the given sequence, it appears that letters are being substituted with numbers in a pattern. Let’s analyze the pattern:

  1. er ar sr pr
  2. er ar sr 9
  3. er ar 6 9
  4. er 3 6 9

From this pattern, we can deduce that:

  • ‘pr’ is replaced by 9
  • ‘sr’ is replaced by 6
  • ‘ar’ is replaced by 3

So, to find ‘ar + sr + pr’, we would calculate:

3 (for ‘ar’) + 6 (for ‘sr’) + 9 (for ‘pr’) = 18.

Therefore, ‘ar + sr + pr’ equals 18.

This time I wanted to mix it up a bit and see if given a more complicated pattern and variables which one is unlikely to find elsewhere, it could perform as well, which it did. Still, this and the previous two tasks are fairly straight forward.

Task 4

Prompt

Examine the following lines:

er ar sr pr
er ar sr 9
er ar 6 9
er 3 6 9

What would er + pr be?

Response

To solve for ‘er + pr’ from the given sequences:

  1. er ar sr pr
  2. er ar sr 9
  3. er ar 6 9
  4. er 3 6 9

We can observe that:

  • ‘pr’ is substituted by 9.
  • ‘er’ remains unchanged in all lines, implying that it is not substituted by a number.

Therefore, we cannot determine a numerical value for ‘er’ from the given sequences. Since ‘er’ does not have a corresponding numerical value like the other elements, ‘er + pr’ cannot be calculated in a conventional numeric sense. It remains as ‘er + 9’ based on the information provided.

Here it fails, despite the straightforward pattern, yet with a bit more prompting it is able to figure it out, as shown below.

Prompt

Look at the numerical pattern emerging. Can you now determine what er is?
Response

Given the new perspective to look at the numerical pattern, let’s re-examine the sequences:

  1. er ar sr pr
  2. er ar sr 9
  3. er ar 6 9
  4. er 3 6 9

Analyzing the pattern, it seems each word is being replaced by a number decreasing in a sequence of 3:

  • ‘pr’ is replaced by 9.
  • ‘sr’ is replaced by 6, which is 3 less than 9.
  • ‘ar’ is replaced by 3, which is 3 less than 6.

Following this pattern, ‘er’ would logically be replaced by a number that is 3 less than 3. Therefore, ‘er’ would be 0.

So, if we are to find ‘er + pr’, it would be:

0 (for ‘er’) + 9 (for ‘pr’) = 9.

Therefore, ‘er + pr’ equals 9.

This I find interested, as earlier it was able to determine the pattern where we counted down, but here it didn’t notice until prompted.

Task 5

Let’s changes things a little and get rid of numbers altogether, sticking with letters and symbols I’ve made up. To make things more distinct, since we’re dealing with non-alphanumeric characters, I’ve separated using commas.

Prompt

Examine the following lines:

|_, _|, __, ||
a, _|, __, ||
a, b, __, ||
a, b, c, ||

Given the above comma separated items, how could you spell “cab” without using letters?

Response

To spell “cab” without using letters, based on the pattern provided in the lines, we can replace each letter with its corresponding symbol:

  1. a, b, c, || → a = “|”, b = “|”, c = “__”

So, “cab” would be represented as:

  • c → “__”
  • a → “|_”
  • b → “_|”

Thus, “cab” without using letters would be “__, |_, _|”.

I was pleasantly surprised at this result, and went a bit further.

Prompt

Given the same comma separated lines, how can you spell the word “bad”?
Response

To spell “bad” using the symbols from the given lines, we assign each letter its corresponding symbol:

  1. a, b, c, || → a = “|”, b = “|”, c = “__”

Therefore, “bad” would be represented as:

  • b → “_|”
  • a → “|_”
  • d → “||” (since ’d' is represented by the fourth symbol in each sequence)

So, “bad” without using letters would be “_|, |_, ||”.

Note: Rendering an underscore and divider “_|” in the above requires putting a backslash in front. If you look at the conversation you will not see that, while her I edited the result to show it.

Task 6

Prompt

Examine the following comma separated lines:

olive, live, ive, ve, e
100, live, 200, ve, 300
olive, 150, ive, 250, e

What is “live” + “e” ?

Response

To determine the value of “live” + “e” from the given sequences, let’s analyze the patterns:

  1. olive, live, ive, ve, e
  2. 100, live, 200, ve, 300
  3. olive, 150, ive, 250, e

From these sequences, we can deduce the numerical values of “live” and “e”:

  • In the second sequence, “live” remains unchanged, which implies it doesn’t have a numerical equivalent in this context, or it could be considered as an independent variable.
  • In the same sequence, “e” is replaced by 300.

Since “live” does not have a numerical value assigned in these sequences, we cannot calculate “live” + “e” in a conventional numeric sense. Therefore, the expression remains as “live + 300” based on the information provided.

This is similar to an earlier problem where further prompting is needed.

Prompt

Look again at all three lines to determine what “live” is and then retry the calculation.
Response

Upon reanalyzing the sequences with a focus on matching the numbers by their column:

  1. olive, live, ive, ve, e
  2. 100, live, 200, ve, 300
  3. olive, 150, ive, 250, e

It becomes clear that each word is associated with a number in the same position across different lines. We can thus determine the value of “live” from the third sequence:

  • “olive” corresponds to 100 (from the second sequence) and is placed in the same column as 150 in the third sequence.
  • Therefore, following this pattern, “live” should correspond to 150, as it is in the same position as 150 in the third sequence.

Now, to calculate “live” + “e”:

  • “live” = 150
  • “e” = 300 (as seen in the second sequence)

Adding these together gives:

150 (live) + 300 (e) = 450

Thus, “live” + “e” equals 450.

While it does get the correct result, there is a mistake on the second bullet point, stating, “olive”…is placed in the same column as 150 in the third sequence. There doesn’t seem to be a strong connection between the logic provided and the final result.

Wrap up

Nothing was learned, but maybe a few ideas were generated in ways that one might query and LLM for fun and games. I did find it interesting in the last portion where the logic and answer diverged. I wonder if it’s be possible to find scenarios where that is consistently the case?