ChatGPT for Power Query Questions
Similar to Excel formula questions, ChatGPT is also ok at simple Power Query formula questions. For example, I asked it:
“How do you round to the nearest 0.5 in Power Query?”
ChatGPT got confused at first and gave me a formula containing Excel functions. But it returned the wrong answer even then:

I asked again and it got it right:

Of course, as a beginner you need to know what to do with the code above and while you can ask ChatGPT where to put the code, it’s unlikely to give you the answer you actually need. For
example, I only wanted the formula to use in a custom column, so I needed this part of it:
=Number.Round([Number]*2,0)/2
The rest is redundant.
ChatGPT for Power Pivot Questions
ChatGPT did better with the Power Pivot DAX question I asked it. I
found a question on our Excel Forum and copied and pasted it word for word to see how ChatGPT would fare.
I’m pleased to say it did quite well and even wrote the formula using the table and column names mentioned in the question:

However, I suspect that like Excel and Power Query formulas, as the
questions get more complex, the answers get less reliable.
ChatGPT for VBA
ChatGPT also did well with the VBA question I found on our Excel VBA forum, returning an
almost identical answer to one of our experienced VBA forum moderators:

However, I know it doesn’t always get it right, so don’t count on it being able to automate everything you do 😉
Things to Avoid Asking ChatGPT
I really want to love ChatGPT, and I do for some things but there are some things you should never use it for, well at least not with the current version, which is
ChatGPT-3.
First, don’t get it to do math or check math results. It will give you an answer and assure you it’s correct, but unless the result is two digits or smaller, it’s unlikely to get it right, and even then, it might not.
I was horrified at the math results it returned (see screenshot below). It clearly doesn’t have a calculator built into
its logic, which I’d have thought is pretty simple to do. Even my Google speaker gets the correct answer.

The bottom line is ChatGPT is a natural language AI tool, and it doesn’t have a built in calculator, yet. Maybe it’ll get one in later versions. Until then it should be taught to decline answering math questions.
Asking ChatGPT Leading Questions
If you give it a
leading question, it will follow. For example, I asked ChatGPT if Excel has a BETWEEN function. We can see in the screenshot below that there is RANDBETWEEN function in Excel, but no BETWEEN function:

However, because I asked it in a leading way, it went along with me and gave me the answer it thought I wanted, even though it isn’t true. It even went as far as to make up the arguments and then explain them!

It’s therefore important to phrase your questions in a neutral way to ensure you don’t get a biased result. That
said, even when I started a new chat with an unbiased question, it still assured me there was a BETWEEN function (maybe it was influenced by my previous question):

ChatGPT for Excel – The Bottom Line
ChatGPT is a bit like a politician, you have to fact check everything it tells you. Some of it will be right, some of it will be embellished and some of it will be plain wrong.
I’m sure with each iteration of ChatGPT and other
large language models we’ll see improvements on the limitations I’ve covered here, and let’s hope improvements in math capabilities arrive soon.