{"id":4795,"date":"2024-06-27T22:26:04","date_gmt":"2024-06-27T22:26:04","guid":{"rendered":"https:\/\/cyberthreatintelligencenetwork.com\/?p=4795"},"modified":"2024-06-27T22:30:52","modified_gmt":"2024-06-27T22:30:52","slug":"the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index","status":"publish","type":"post","link":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/","title":{"rendered":"The Evolution of Generative AI: Insights from Stanford&#8217;s 2024 AI Index"},"content":{"rendered":"\n<p>Stanford&#8217;s Human-Centered AI Center recently published a 2024 Index covering developments in the field of Artificial Intelligence (AI).  The nine chapters of the report are summarized below.  The proper citation for the full report is as follows:<\/p>\n\n\n\n<p>Nestor Maslej, Loredana Fattorini, Raymond Perrault, Vanessa Parli, Anka Reuel, Erik Brynjolfsson, John Etchemendy, Katrina Ligett, Terah Lyons, James Manyika, Juan Carlos Niebles, Yoav Shoham, Russell Wald, and Jack Clark,<\/p>\n\n\n\n<p>\u201cThe AI Index 2024 Annual Report,\u201d AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, Stanford, CA, April 2024.<\/p>\n\n\n\n<h3 class=\"wp-block-heading has-text-color has-link-color wp-elements-10adea798ff50d7b7ede81e69824544f\" style=\"color:#0e2899\">Chapter 1: Research and Development<\/h3>\n\n\n\n<p>The past decade has seen a significant shift in AI research and development, with industry taking the lead. In 2023, industry produced 51 notable machine learning models, while academia contributed only 15. This trend is partly due to the escalating costs of training state-of-the-art AI models, which have reached unprecedented levels. For instance, OpenAI&#8217;s GPT-4 required an estimated $78 million worth of compute to train, while Google&#8217;s Gemini Ultra cost $191 million. Despite these high costs, the number of foundation models has more than doubled from 2022 to 2023, with a significant portion being open-source. This surge in open-source models is fostering greater collaboration and innovation across the AI community[1][2][3].<\/p>\n\n\n\n<h3 class=\"wp-block-heading has-text-color has-link-color wp-elements-d5da78ffbf3388e309df39b013e4a197\" style=\"color:#0e2899\">Chapter 2: Technical Performance<\/h3>\n\n\n\n<p>AI&#8217;s technical performance has seen remarkable advancements, with AI systems surpassing human capabilities in several benchmarks, including image classification, visual reasoning, and English understanding. However, AI still lags in more complex tasks such as competition-level mathematics and visual commonsense reasoning. The development of multimodal AI models like Google&#8217;s Gemini and OpenAI&#8217;s GPT-4, which can handle text, images, and audio, marks a significant leap in AI capabilities. Additionally, the emergence of more challenging benchmarks in 2023, such as SWE-bench for coding and MoCa for moral reasoning, indicates a push towards testing AI on more complex and nuanced tasks[1][4][5].<\/p>\n\n\n\n<h3 class=\"wp-block-heading has-text-color has-link-color wp-elements-740917e46b8b9fbf617556a99c780cad\" style=\"color:#0e2899\">Chapter 3: Responsible AI<\/h3>\n\n\n\n<p>The responsible development and deployment of AI have become critical focal points. The report highlights a significant lack of standardized evaluations for large language models (LLMs) regarding responsibility, with leading developers testing their models against different benchmarks. This inconsistency complicates efforts to systematically compare the risks and limitations of top AI models. Moreover, the rise of political deepfakes and the discovery of complex vulnerabilities in LLMs underscore the urgent need for robust and standardized responsible AI practices. The chapter also discusses the growing concern among businesses about AI-related risks, including privacy, data security, and reliability[1][4][6].<\/p>\n\n\n\n<h3 class=\"wp-block-heading has-text-color has-link-color wp-elements-d84c6622ea3bc56d47ae7a755904cd23\" style=\"color:#0e2899\">Chapter 4: Economy<\/h3>\n\n\n\n<p>Generative AI has become a major driver of economic activity, with investment in this area skyrocketing. Despite a decline in overall AI private investment, funding for generative AI surged nearly eightfold from 2022, reaching $25.2 billion. This surge is indicative of the broader trend of integrating AI into various industries to enhance productivity and efficiency. Studies have shown that AI enables workers to complete tasks more quickly and improve the quality of their output, bridging the skill gap between low- and high-skilled workers. However, the economic impact of AI also raises concerns about potential job displacement and the need for proper oversight to avoid diminished performance[1][6][7].<\/p>\n\n\n\n<h3 class=\"wp-block-heading has-text-color has-link-color wp-elements-3e42f6b6fbeea8f6ff8af34cf26dcf8a\" style=\"color:#0e2899\">Chapter 5: Science and Medicine<\/h3>\n\n\n\n<p>AI is revolutionizing science and medicine, accelerating scientific discovery and medical advancements. In 2023, significant AI applications were launched, such as AlphaDev for efficient algorithmic sorting and GNoME for materials discovery. In medicine, AI systems like EVEscape for pandemic prediction and AlphaMissence for mutation classification have made substantial strides. The performance of AI on medical benchmarks has also improved remarkably, with models like GPT-4 Medprompt achieving high accuracy rates. The FDA&#8217;s approval of AI-related medical devices has increased significantly, highlighting the growing role of AI in real-world medical applications[1][4][8].<\/p>\n\n\n\n<h3 class=\"wp-block-heading has-text-color has-link-color wp-elements-5e3c31909cb85bd84499b85319505be3\" style=\"color:#0e2899\">Chapter 6: Education<\/h3>\n\n\n\n<p>AI&#8217;s integration into education is transforming learning and teaching methodologies. The number of AI-related degree programs has tripled since 2017, reflecting the growing demand for AI expertise. However, access to computer science (CS) education remains uneven, with students in larger high schools and suburban areas more likely to have access to CS courses. The migration of AI PhDs to industry continues to accelerate, indicating a brain drain from academia. Despite these challenges, the diversity in CS education is improving, with increasing representation from various ethnic groups and a rise in the participation of female students in AP CS exams[1][4][9].<\/p>\n\n\n\n<h3 class=\"wp-block-heading has-text-color has-link-color wp-elements-8c8524acb71fbf70acfbb3aee7c7b0f0\" style=\"color:#0e2899\">Chapter 7: Policy and Governance<\/h3>\n\n\n\n<p>AI policy and governance have seen significant developments, with a sharp increase in AI-related regulations. In 2023, the number of AI-related regulations in the United States grew by 56.3%, reflecting the heightened focus on AI governance. Both the United States and the European Union have advanced landmark AI policy actions, including the AI Act in the EU and an Executive Order on AI in the US. The chapter also highlights the global discourse on AI, with AI being mentioned in legislative proceedings in 49 countries in 2023. This growing regulatory landscape underscores the need for balanced policies that promote innovation while addressing potential risks[1][4][10].<\/p>\n\n\n\n<h3 class=\"wp-block-heading has-text-color has-link-color wp-elements-47366a06b53991c449285fc786a4160c\" style=\"color:#0e2899\">Chapter 8: Diversity<\/h3>\n\n\n\n<p>Diversity in AI education and the workforce is gradually improving, though substantial gaps remain. In the United States and Canada, the representation of Asian, Hispanic, and Black or African American students in CS degree programs has increased. However, gender gaps persist, particularly in European informatics, CS, CE, and IT graduates. The participation of female students in AP CS exams in the US has risen significantly, reflecting broader changes in gender and ethnic representation in K-12 CS education. These trends highlight the ongoing efforts to create a more inclusive and diverse AI ecosystem[1][4][11].<\/p>\n\n\n\n<h3 class=\"wp-block-heading has-text-color has-link-color wp-elements-f834afca88c6ffdc2b487e3e88dead68\" style=\"color:#0e2899\">Chapter 9: Public Opinion<\/h3>\n\n\n\n<p>Public opinion on AI is becoming increasingly nuanced, with a growing awareness of AI&#8217;s potential impact. Surveys indicate that a significant proportion of people believe AI will dramatically affect their lives in the next few years, with many expressing nervousness about AI products and services. In the US, more people report feeling concerned than excited about AI. The chapter also explores demographic differences in AI optimism, with younger generations and individuals with higher incomes and education levels generally more positive about AI&#8217;s potential benefits. The widespread awareness and use of tools like ChatGPT further illustrate AI&#8217;s growing presence in everyday life[1][4][12].<\/p>\n\n\n\n<p>These paragraphs provide a comprehensive overview of the key themes and findings from each chapter of the 2024 AI Index Report, reflecting the growth and development of generative AI over the past decade.<\/p>\n\n\n\n<p>Citations:<br>[1] https:\/\/ppl-ai-file-upload.s3.amazonaws.com\/web\/direct-files\/7036048\/85615ab0-9b61-4f60-9b2c-8a2c8e44a1bf\/HAI-Highlights.pdf<br>[2] https:\/\/hai.stanford.edu\/research\/ai-index-report<br>[3] https:\/\/hai.stanford.edu\/news\/inside-new-ai-index-expensive-new-models-targeted-investments-and-more<br>[4] https:\/\/aiindex.stanford.edu\/report\/<br>[5] https:\/\/hai.stanford.edu\/news\/what-expect-ai-2024<br>[6] https:\/\/www.linkedin.com\/pulse\/2024-artificial-intelligence-index-report-stanford-hai-savelsbergh-ttlkc<br>[7] https:\/\/radical.vc\/2024-ai-index-report\/<br>[8] https:\/\/hai.stanford.edu\/news\/ai-index-state-ai-13-charts<br>[9] https:\/\/www.linkedin.com\/posts\/datacouch_ai-index-report-2024-by-stanford-institute-activity-7186284974826815489-1bzw<br>[10] https:\/\/www.fladgate.com\/insights\/what-stanford-universitys-2024-ai-index-report-tells-us-about-the-current-state-of-ai<br>[11] https:\/\/spectrum.ieee.org\/ai-index-2024<br>[12] https:\/\/hai.stanford.edu\/events\/presenting-2024-ai-index<br>[13] https:\/\/www.infoq.com\/news\/2024\/05\/stanford-ai-index\/<br>[14] https:\/\/aiindex.stanford.edu\/research\/<br>[15] https:\/\/www.linkedin.com\/pulse\/navigating-ai-frontier-insights-implications-from-stanford-amin-isnwf?trk=public_post_main-feed-card_feed-article-content<br>[16] https:\/\/www.niso.org\/niso-io\/2024\/04\/ai-index-report-2024-reveals-accelerating-activity<br>[17] https:\/\/www.aei.org\/technology-and-innovation\/six-takeaways-from-stanford-universitys-2024-report-on-the-state-ai\/<br>[18] https:\/\/spectrum.ieee.org\/ai-index-2024\/7-industry-calls-new-phds<br>[19] https:\/\/scai.sorbonne-universite.fr\/public\/news\/view\/c27e00072f7aa92ddc77\/8<br>[20] https:\/\/codingscape.com\/blog\/stanford-ai-index-2024-summary-and-full-report<\/p>\n","protected":false},"excerpt":{"rendered":"<p>AI has surpassed human performance on several benchmarks, including some in image classification, visual reasoning, and English understanding. Yet it trails behind on more complex tasks like competition-level mathematics, visual commonsense reasoning and planning.<\/p>\n","protected":false},"author":2,"featured_media":4474,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[2532,330],"tags":[2527],"class_list":["post-4795","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-operations","tag-artificial-intelligence"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO Pro 4.9.5.2 - aioseo.com -->\n\t<meta name=\"description\" content=\"AI has surpassed human performance on several benchmarks, including some in image classification, visual reasoning, and English understanding. Yet it trails behind on more complex tasks like competition-level mathematics, visual commonsense reasoning and planning.\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Jane Ginn\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO Pro (AIOSEO) 4.9.5.2\" \/>\n\t\t<meta property=\"og:locale\" content=\"en_US\" \/>\n\t\t<meta property=\"og:site_name\" content=\"CTIN - Cybersecurity Center\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"The Evolution of Generative AI: Insights from Stanford\u2019s 2024 AI Index - CTIN\" \/>\n\t\t<meta property=\"og:description\" content=\"AI has surpassed human performance on several benchmarks, including some in image classification, visual reasoning, and English understanding. Yet it trails behind on more complex tasks like competition-level mathematics, visual commonsense reasoning and planning.\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/cyberthreatintelligencenetwork.com\/wp-content\/uploads\/2024\/05\/SocialShare-Image.png\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/cyberthreatintelligencenetwork.com\/wp-content\/uploads\/2024\/05\/SocialShare-Image.png\" \/>\n\t\t<meta property=\"og:image:width\" content=\"112\" \/>\n\t\t<meta property=\"og:image:height\" content=\"112\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2024-06-27T22:26:04+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2024-06-27T22:30:52+00:00\" \/>\n\t\t<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/CyberThreatIntelligenceNetwork\/\" \/>\n\t\t<meta name=\"twitter:card\" content=\"summary\" \/>\n\t\t<meta name=\"twitter:site\" content=\"@CTIN_Global\" \/>\n\t\t<meta name=\"twitter:title\" content=\"The Evolution of Generative AI: Insights from Stanford\u2019s 2024 AI Index - CTIN\" \/>\n\t\t<meta name=\"twitter:description\" content=\"AI has surpassed human performance on several benchmarks, including some in image classification, visual reasoning, and English understanding. Yet it trails behind on more complex tasks like competition-level mathematics, visual commonsense reasoning and planning.\" \/>\n\t\t<meta name=\"twitter:creator\" content=\"@CTIN_Global\" \/>\n\t\t<meta name=\"twitter:image\" content=\"https:\/\/cyberthreatintelligencenetwork.com\/wp-content\/uploads\/2024\/05\/SocialShare-Image.png\" \/>\n\t\t<script type=\"application\/ld+json\" class=\"aioseo-schema\">\n\t\t\t{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"BlogPosting\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/2024\\\/06\\\/27\\\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\\\/#blogposting\",\"name\":\"The Evolution of Generative AI: Insights from Stanford\\u2019s 2024 AI Index - CTIN\",\"headline\":\"The Evolution of Generative AI: Insights from Stanford&#8217;s 2024 AI Index\",\"author\":{\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/author\\\/neffie\\\/#author\"},\"publisher\":{\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/#organization\"},\"image\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/wp-content\\\/uploads\\\/2024\\\/06\\\/HumanChatbot-RS.png\",\"width\":1226,\"height\":706,\"caption\":\"Human sitting across a table with an AI image\"},\"datePublished\":\"2024-06-27T22:26:04+00:00\",\"dateModified\":\"2024-06-27T22:30:52+00:00\",\"inLanguage\":\"en-US\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/2024\\\/06\\\/27\\\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\\\/#webpage\"},\"isPartOf\":{\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/2024\\\/06\\\/27\\\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\\\/#webpage\"},\"articleSection\":\"AI, Operations, artificial intelligence\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/2024\\\/06\\\/27\\\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\\\/#breadcrumblist\",\"itemListElement\":[{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com#listItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/blog\\\/posts\\\/#listItem\",\"name\":\"Posts\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/blog\\\/posts\\\/#listItem\",\"position\":2,\"name\":\"Posts\",\"item\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/blog\\\/posts\\\/\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/category\\\/cybersecurity\\\/#listItem\",\"name\":\"CyberSecurity\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com#listItem\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/category\\\/cybersecurity\\\/#listItem\",\"position\":3,\"name\":\"CyberSecurity\",\"item\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/category\\\/cybersecurity\\\/\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/category\\\/cybersecurity\\\/ai\\\/#listItem\",\"name\":\"AI\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/blog\\\/posts\\\/#listItem\",\"name\":\"Posts\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/category\\\/cybersecurity\\\/ai\\\/#listItem\",\"position\":4,\"name\":\"AI\",\"item\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/category\\\/cybersecurity\\\/ai\\\/\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/2024\\\/06\\\/27\\\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\\\/#listItem\",\"name\":\"The Evolution of Generative AI: Insights from Stanford&#8217;s 2024 AI Index\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/category\\\/cybersecurity\\\/#listItem\",\"name\":\"CyberSecurity\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/2024\\\/06\\\/27\\\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\\\/#listItem\",\"position\":5,\"name\":\"The Evolution of Generative AI: Insights from Stanford&#8217;s 2024 AI Index\",\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/category\\\/cybersecurity\\\/ai\\\/#listItem\",\"name\":\"AI\"}}]},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/#organization\",\"name\":\"Cyber Threat Intelligence Network\",\"description\":\"Cybersecurity Center\",\"url\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/\",\"telephone\":\"+14804624039\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/wp-content\\\/uploads\\\/2021\\\/01\\\/cropped-cropped-2020-logo.png\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/2024\\\/06\\\/27\\\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\\\/#organizationLogo\",\"width\":757,\"height\":237},\"image\":{\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/2024\\\/06\\\/27\\\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\\\/#organizationLogo\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/CyberThreatIntelligenceNetwork\\\/\",\"https:\\\/\\\/twitter.com\\\/CTIN_Global\",\"https:\\\/\\\/www.linkedin.com\\\/in\\\/janeginn\\\/\",\"https:\\\/\\\/bsky.app\\\/profile\\\/janeginn.bsky.social\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/author\\\/neffie\\\/#author\",\"url\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/author\\\/neffie\\\/\",\"name\":\"Jane Ginn\",\"image\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/wp-content\\\/uploads\\\/2024\\\/07\\\/rjg-PhonePhoto.PNG\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/CTIN_Global\",\"https:\\\/\\\/www.linkedin.com\\\/in\\\/janeginn\\\/\",\"https:\\\/\\\/bsky.app\\\/profile\\\/janeginn.bsky.social\",\"https:\\\/\\\/infosec.exchange\\\/@ctin\"],\"description\":\"As the co-founder of the US-based Cyber Threat Intelligence Network (CTIN), a consultancy with partners in Europe, Ms. Ginn has been pivotal in the development of the STIX international standard for modeling and sharing threat intelligence. Her work with the Cyber Threat Intelligence (CTI) technical committee earned her the 2020 Distinguished Contributor award from OASIS. She is currently supporting the analysis services of Datos Insights, an advisory firm focusing on the financial services sector. In public service, she advised five Secretaries of the US Department of Commerce on international trade issues from 1994 to 2001 and served on the Washington District Export Council for five years. In the EU, she was an appointed member of the European Union's ENISA Threat Landscape Stakeholders' Group for four years. A world traveler and amateur photojournalist, she has visited over 50 countries, further enriching her global outlook and professional insights. Follow me on LinkedIn\",\"jobTitle\":\"CTIN President & Co-Founder\",\"alumniOf\":[{\"@type\":\"EducationalOrganization\",\"name\":\"Norwich University\",\"sameAs\":\"https:\\\/\\\/online.norwich.edu\\\/online\\\/programs-courses\\\/programs\\\/master-science-cybersecurity\"}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/2024\\\/06\\\/27\\\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\\\/#webpage\",\"url\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/2024\\\/06\\\/27\\\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\\\/\",\"name\":\"The Evolution of Generative AI: Insights from Stanford\\u2019s 2024 AI Index - CTIN\",\"description\":\"AI has surpassed human performance on several benchmarks, including some in image classification, visual reasoning, and English understanding. Yet it trails behind on more complex tasks like competition-level mathematics, visual commonsense reasoning and planning.\",\"inLanguage\":\"en-US\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/#website\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/2024\\\/06\\\/27\\\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\\\/#breadcrumblist\"},\"author\":{\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/author\\\/neffie\\\/#author\"},\"creator\":{\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/author\\\/neffie\\\/#author\"},\"image\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/wp-content\\\/uploads\\\/2024\\\/06\\\/HumanChatbot-RS.png\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/2024\\\/06\\\/27\\\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\\\/#mainImage\",\"width\":1226,\"height\":706,\"caption\":\"Human sitting across a table with an AI image\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/index.php\\\/2024\\\/06\\\/27\\\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\\\/#mainImage\"},\"datePublished\":\"2024-06-27T22:26:04+00:00\",\"dateModified\":\"2024-06-27T22:30:52+00:00\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/#website\",\"url\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/\",\"name\":\"Training Center\",\"description\":\"Cybersecurity Center\",\"inLanguage\":\"en-US\",\"publisher\":{\"@id\":\"https:\\\/\\\/cyberthreatintelligencenetwork.com\\\/#organization\"}}]}\n\t\t<\/script>\n\t\t<!-- All in One SEO Pro -->\r\n\t\t<title>The Evolution of Generative AI: Insights from Stanford\u2019s 2024 AI Index - CTIN<\/title>\n\n","aioseo_head_json":{"title":"The Evolution of Generative AI: Insights from Stanford\u2019s 2024 AI Index - CTIN","description":"AI has surpassed human performance on several benchmarks, including some in image classification, visual reasoning, and English understanding. Yet it trails behind on more complex tasks like competition-level mathematics, visual commonsense reasoning and planning.","canonical_url":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"BlogPosting","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/#blogposting","name":"The Evolution of Generative AI: Insights from Stanford\u2019s 2024 AI Index - CTIN","headline":"The Evolution of Generative AI: Insights from Stanford&#8217;s 2024 AI Index","author":{"@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/author\/neffie\/#author"},"publisher":{"@id":"https:\/\/cyberthreatintelligencenetwork.com\/#organization"},"image":{"@type":"ImageObject","url":"https:\/\/cyberthreatintelligencenetwork.com\/wp-content\/uploads\/2024\/06\/HumanChatbot-RS.png","width":1226,"height":706,"caption":"Human sitting across a table with an AI image"},"datePublished":"2024-06-27T22:26:04+00:00","dateModified":"2024-06-27T22:30:52+00:00","inLanguage":"en-US","mainEntityOfPage":{"@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/#webpage"},"isPartOf":{"@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/#webpage"},"articleSection":"AI, Operations, artificial intelligence"},{"@type":"BreadcrumbList","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/#breadcrumblist","itemListElement":[{"@type":"ListItem","@id":"https:\/\/cyberthreatintelligencenetwork.com#listItem","position":1,"name":"Home","item":"https:\/\/cyberthreatintelligencenetwork.com","nextItem":{"@type":"ListItem","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/blog\/posts\/#listItem","name":"Posts"}},{"@type":"ListItem","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/blog\/posts\/#listItem","position":2,"name":"Posts","item":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/blog\/posts\/","nextItem":{"@type":"ListItem","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/category\/cybersecurity\/#listItem","name":"CyberSecurity"},"previousItem":{"@type":"ListItem","@id":"https:\/\/cyberthreatintelligencenetwork.com#listItem","name":"Home"}},{"@type":"ListItem","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/category\/cybersecurity\/#listItem","position":3,"name":"CyberSecurity","item":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/category\/cybersecurity\/","nextItem":{"@type":"ListItem","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/category\/cybersecurity\/ai\/#listItem","name":"AI"},"previousItem":{"@type":"ListItem","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/blog\/posts\/#listItem","name":"Posts"}},{"@type":"ListItem","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/category\/cybersecurity\/ai\/#listItem","position":4,"name":"AI","item":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/category\/cybersecurity\/ai\/","nextItem":{"@type":"ListItem","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/#listItem","name":"The Evolution of Generative AI: Insights from Stanford&#8217;s 2024 AI Index"},"previousItem":{"@type":"ListItem","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/category\/cybersecurity\/#listItem","name":"CyberSecurity"}},{"@type":"ListItem","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/#listItem","position":5,"name":"The Evolution of Generative AI: Insights from Stanford&#8217;s 2024 AI Index","previousItem":{"@type":"ListItem","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/category\/cybersecurity\/ai\/#listItem","name":"AI"}}]},{"@type":"Organization","@id":"https:\/\/cyberthreatintelligencenetwork.com\/#organization","name":"Cyber Threat Intelligence Network","description":"Cybersecurity Center","url":"https:\/\/cyberthreatintelligencenetwork.com\/","telephone":"+14804624039","logo":{"@type":"ImageObject","url":"https:\/\/cyberthreatintelligencenetwork.com\/wp-content\/uploads\/2021\/01\/cropped-cropped-2020-logo.png","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/#organizationLogo","width":757,"height":237},"image":{"@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/#organizationLogo"},"sameAs":["https:\/\/www.facebook.com\/CyberThreatIntelligenceNetwork\/","https:\/\/twitter.com\/CTIN_Global","https:\/\/www.linkedin.com\/in\/janeginn\/","https:\/\/bsky.app\/profile\/janeginn.bsky.social"]},{"@type":"Person","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/author\/neffie\/#author","url":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/author\/neffie\/","name":"Jane Ginn","image":{"@type":"ImageObject","url":"https:\/\/cyberthreatintelligencenetwork.com\/wp-content\/uploads\/2024\/07\/rjg-PhonePhoto.PNG"},"sameAs":["https:\/\/x.com\/CTIN_Global","https:\/\/www.linkedin.com\/in\/janeginn\/","https:\/\/bsky.app\/profile\/janeginn.bsky.social","https:\/\/infosec.exchange\/@ctin"],"description":"As the co-founder of the US-based Cyber Threat Intelligence Network (CTIN), a consultancy with partners in Europe, Ms. Ginn has been pivotal in the development of the STIX international standard for modeling and sharing threat intelligence. Her work with the Cyber Threat Intelligence (CTI) technical committee earned her the 2020 Distinguished Contributor award from OASIS. She is currently supporting the analysis services of Datos Insights, an advisory firm focusing on the financial services sector. In public service, she advised five Secretaries of the US Department of Commerce on international trade issues from 1994 to 2001 and served on the Washington District Export Council for five years. In the EU, she was an appointed member of the European Union's ENISA Threat Landscape Stakeholders' Group for four years. A world traveler and amateur photojournalist, she has visited over 50 countries, further enriching her global outlook and professional insights. Follow me on LinkedIn","jobTitle":"CTIN President & Co-Founder","alumniOf":[{"@type":"EducationalOrganization","name":"Norwich University","sameAs":"https:\/\/online.norwich.edu\/online\/programs-courses\/programs\/master-science-cybersecurity"}]},{"@type":"WebPage","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/#webpage","url":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/","name":"The Evolution of Generative AI: Insights from Stanford\u2019s 2024 AI Index - CTIN","description":"AI has surpassed human performance on several benchmarks, including some in image classification, visual reasoning, and English understanding. Yet it trails behind on more complex tasks like competition-level mathematics, visual commonsense reasoning and planning.","inLanguage":"en-US","isPartOf":{"@id":"https:\/\/cyberthreatintelligencenetwork.com\/#website"},"breadcrumb":{"@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/#breadcrumblist"},"author":{"@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/author\/neffie\/#author"},"creator":{"@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/author\/neffie\/#author"},"image":{"@type":"ImageObject","url":"https:\/\/cyberthreatintelligencenetwork.com\/wp-content\/uploads\/2024\/06\/HumanChatbot-RS.png","@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/#mainImage","width":1226,"height":706,"caption":"Human sitting across a table with an AI image"},"primaryImageOfPage":{"@id":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/#mainImage"},"datePublished":"2024-06-27T22:26:04+00:00","dateModified":"2024-06-27T22:30:52+00:00"},{"@type":"WebSite","@id":"https:\/\/cyberthreatintelligencenetwork.com\/#website","url":"https:\/\/cyberthreatintelligencenetwork.com\/","name":"Training Center","description":"Cybersecurity Center","inLanguage":"en-US","publisher":{"@id":"https:\/\/cyberthreatintelligencenetwork.com\/#organization"}}]},"og:locale":"en_US","og:site_name":"CTIN - Cybersecurity Center","og:type":"article","og:title":"The Evolution of Generative AI: Insights from Stanford\u2019s 2024 AI Index - CTIN","og:description":"AI has surpassed human performance on several benchmarks, including some in image classification, visual reasoning, and English understanding. Yet it trails behind on more complex tasks like competition-level mathematics, visual commonsense reasoning and planning.","og:url":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/","og:image":"https:\/\/cyberthreatintelligencenetwork.com\/wp-content\/uploads\/2024\/05\/SocialShare-Image.png","og:image:secure_url":"https:\/\/cyberthreatintelligencenetwork.com\/wp-content\/uploads\/2024\/05\/SocialShare-Image.png","og:image:width":112,"og:image:height":112,"article:published_time":"2024-06-27T22:26:04+00:00","article:modified_time":"2024-06-27T22:30:52+00:00","article:publisher":"https:\/\/www.facebook.com\/CyberThreatIntelligenceNetwork\/","twitter:card":"summary","twitter:site":"@CTIN_Global","twitter:title":"The Evolution of Generative AI: Insights from Stanford\u2019s 2024 AI Index - CTIN","twitter:description":"AI has surpassed human performance on several benchmarks, including some in image classification, visual reasoning, and English understanding. Yet it trails behind on more complex tasks like competition-level mathematics, visual commonsense reasoning and planning.","twitter:creator":"@CTIN_Global","twitter:image":"https:\/\/cyberthreatintelligencenetwork.com\/wp-content\/uploads\/2024\/05\/SocialShare-Image.png"},"aioseo_meta_data":{"post_id":"4795","title":null,"description":null,"keywords":null,"keyphrases":{"focus":{"keyphrase":"","score":0,"analysis":{"keyphraseInTitle":{"score":0,"maxScore":9,"error":1}}},"additional":[]},"primary_term":{"category":2532},"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":"","og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"BlogPosting","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":"-1","robots_max_videopreview":"-1","robots_max_imagepreview":"large","priority":null,"frequency":"default","local_seo":null,"seo_analyzer_scan_date":"2025-08-25 22:09:20","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"open_ai":"{\"title\":{\"suggestions\":[],\"usage\":0},\"description\":{\"suggestions\":[],\"usage\":0}}","ai":null,"created":"2024-06-27 22:17:39","updated":"2025-08-25 22:09:20"},"aioseo_breadcrumb":"<div class=\"aioseo-breadcrumbs\"><span class=\"aioseo-breadcrumb\">\n\t<a href=\"https:\/\/cyberthreatintelligencenetwork.com\" title=\"Home\">Home<\/a>\n<\/span><span class=\"aioseo-breadcrumb-separator\">\u00bb<\/span><span class=\"aioseo-breadcrumb\">\n\t<a href=\"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/blog\/posts\/\" title=\"Posts\">Posts<\/a>\n<\/span><span class=\"aioseo-breadcrumb-separator\">\u00bb<\/span><span class=\"aioseo-breadcrumb\">\n\t<a href=\"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/category\/cybersecurity\/\" title=\"CyberSecurity\">CyberSecurity<\/a>\n<\/span><span class=\"aioseo-breadcrumb-separator\">\u00bb<\/span><span class=\"aioseo-breadcrumb\">\n\t<a href=\"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/category\/cybersecurity\/ai\/\" title=\"AI\">AI<\/a>\n<\/span><span class=\"aioseo-breadcrumb-separator\">\u00bb<\/span><span class=\"aioseo-breadcrumb\">\n\tThe Evolution of Generative AI: Insights from Stanford\u2019s 2024 AI Index\n<\/span><\/div>","aioseo_breadcrumb_json":[{"label":"Home","link":"https:\/\/cyberthreatintelligencenetwork.com"},{"label":"Posts","link":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/blog\/posts\/"},{"label":"CyberSecurity","link":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/category\/cybersecurity\/"},{"label":"AI","link":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/category\/cybersecurity\/ai\/"},{"label":"The Evolution of Generative AI: Insights from Stanford&#8217;s 2024 AI Index","link":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/2024\/06\/27\/the-evolution-of-generative-ai-insights-from-stanfords-2024-ai-index\/"}],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/wp-json\/wp\/v2\/posts\/4795","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/wp-json\/wp\/v2\/comments?post=4795"}],"version-history":[{"count":4,"href":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/wp-json\/wp\/v2\/posts\/4795\/revisions"}],"predecessor-version":[{"id":4800,"href":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/wp-json\/wp\/v2\/posts\/4795\/revisions\/4800"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/wp-json\/wp\/v2\/media\/4474"}],"wp:attachment":[{"href":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/wp-json\/wp\/v2\/media?parent=4795"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/wp-json\/wp\/v2\/categories?post=4795"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cyberthreatintelligencenetwork.com\/index.php\/wp-json\/wp\/v2\/tags?post=4795"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}