In 2023 the big thing being talked about, especially in marketing circles, is ChatGPT, but what is the accuracy of ChatGPT like? I figured a good test of ChatGPT accuracy was to see what it knows about me. After all, I am the authority on me I’d like to think! Current at 12 March 2023.
What is ChatGPT from Open AI?
If you’re out of the loop, ChatGPT from OpenAI is a pretty fast and widely hyped online artificial intelligence tool. They are currently in testing mode, and are therefore encouraging it’s widespread use and ratings of it’s accuracy so it can build it’s intelligence. After all, artificial intelligence (AI) is only as good as the information fed into it. Currently the product is a freemium model, with most users using the software for free, and recent paid options being brought in, in a sign of things to come.
How do you use ChatGPT?
You simply create a login and then ask questions or ‘ChatGPT prompts’. ChatGPT works on an iterative process. So you can ask it to do something like write a bio as I’ve done below. Then you could ask it to rewrite it with a tone of voice like as if you were say Jerry Maguire, or turn it into a poem. It is great for coming up with ideas. Things like 20 tips to … It can even write Excel formulas for you. However, for all these exciting things, it does some things not so well.
The accuracy and source of ChatGPT generated content
ChatGPT openly says in it’s disclaimer that it’s not fully up to date (with data sourced only up to 2021), and it is not necessarily using reliable sources. After all how does it know whether, just because it was on the internet, if it was the right answer to a question. Therefore every statistic, every comment needs to be checked before being regurgitated. Ideally for most purposes you would not use the ChatGPT output as is.
Particularly if using for blogging or for long form content, you want to incorporate your business brand voice.
ChatGPT accuracy test – my biography
So I asked ChatGPT to provide a 200 word bio for Jane Tweedy (something I’ll clearly know more about than it). This is what happened… [my corrections are in square brackets].
“Jane Tweedy is a successful entrepreneur and business coach based in Sydney, Australia. With over 20 years of experience in corporate management [corporate yes, management not all of it], she has developed an extensive skill set that enables her to help small business owners and solopreneurs grow their businesses.
Jane began her career in the telecommunications industry [where did that come from – no telco ever], where she held various senior management [middle yes, senior no] positions before transitioning to business coaching. In 2011 [hmmm no, years later], she founded her own business coaching practice, FAQ Business Training, [coaching is actually under FAQ Business Consulting] which focuses on helping small business owners and entrepreneurs develop the skills they need to succeed.
As a business coach, Jane is known for her down-to-earth approach and her ability to simplify complex concepts into actionable steps [this is the advice and training component, not really coaching, though I do offer together in one-on-one or group sessions]. She offers a range of services, including one-on-one coaching, group coaching, and workshops, and has helped hundreds of clients achieve their business goals.
In addition to her coaching [and training] practice, Jane is an active member of the business community. She is a regular speaker at industry events and has served as a mentor for several business incubator programs. She is also a member of the Australian Institute of Company Directors [no, never been] and the International Coach Federation.
Overall, Jane Tweedy is a respected business coach and entrepreneur who is dedicated to helping small business owners and entrepreneurs achieve success.”
Overall accuracy of my ChatGPT generated bio
First of all let’s acknowledge how quick it was! Way quicker than I could put together a 200 word bio, even using my talking it out (voice to text) hack. Overall it scraped reasonably accurate information, with a few really odd things like the Telco and AICD references? This proves my point, you need to check EVERYTHING it produces to make sure it’s accurate before using it.
It’s also a bit bland and misses my personality. That’s why you want to add your tone and brand voice (plus to ensure it doesn’t become the same as other content out there).
Summary on the output of ChatGPT
So overall summary, have a play with ChatGPT and it’s great for getting something on the page quickly! BUT, don’t assume everything it says is accurate! You need to check and fact check, apply your tone of voice, and therefore it’s a good base but not the end product!
Need marketing and content tips and help?
FAQ Business provides training, coaching and support to small to medium businesses. Please contact us or check out our online training.
0 Comments