AI and Algorithm Auditing Certificate | Lunchtime BABLing 25

BABL AI Inc.
24 Oct 202306:57

TLDRLunchtime Babbling is back for Season 2, diving into the world of generative AI, its governance, and testing methods. The show discusses the impact of the Digital Services Act and the EU AI Act, highlighting the growing interest in AI audits. A significant focus has been the AI and Algorithm Auditor Certificate Program, which aims to address the shortage of skilled professionals in responsible AI. The program, initially for internal auditors, has expanded to a broader audience, with the first cohort completing the certification exam. The training consists of five courses covering AI and machine learning, algorithmic risk assessments, AI governance, bias and accuracy in AI testing, and algorithm auditing standards. As AI assurance becomes more critical, the show is excited to see the program's graduates entering a growing market.

Takeaways

  • 🎉 The show 'Lunchtime Babbling' is back with Season 2, focusing on generative AI, testing, and governance.
  • 📜 The Digital Services Act has come into force, impacting the technology and AI landscape.
  • 📝 The EU AI Act is currently in the trialogue process, indicating ongoing development and potential future changes.
  • 🌐 Generative AI has been a major topic in recent headlines, indicating its growing importance and relevance.
  • 📊 The AI and Algorithm Auditor Certificate Program was developed to address a skills gap in responsible AI and technical risk assessment.
  • 👩‍💼 The program was initially for internal auditors but was opened to the public due to high interest.
  • 🎓 The training consists of five courses covering AI technical knowledge, ethical risk assessments, AI governance, bias and statistics, and algorithm auditing.
  • 🔍 The courses emphasize connecting socio-technical aspects with technical performance metrics to assess AI systems.
  • 📈 The program has seen its first cohort of students complete the certification exam, becoming certified AI and algorithm auditors.
  • 🚀 As laws like the Digital Services Act come into effect, there is an increasing demand for AI assurance services.
  • 🌟 The show encourages viewers to like, subscribe, and take advantage of a discount code for the course.

Q & A

  • What is the main focus of the new season of Lunchtime Babbling?

    -The main focus of the new season is to explore generative AI, its testing, governance, and the impact of the Digital Services Act and the EU AI Act.

  • What has been the primary activity during the busy audit season and summertime?

    -The primary activity has been working on audits, particularly for New York City local law 144 and the EU AI Act, even though it has not come into effect yet.

  • Why is there a lot of interest in the EU AI Act despite it not being finalized?

    -Companies are realizing the importance of the EU AI Act and are preparing for its potential impact, even though the trialogue process is still ongoing.

  • What is the AI and Algorithm Auditor Certificate Program?

    -It is a training program developed to address the shortage of skilled individuals in responsible AI and technical risk assessment, initially for the company's auditors but later opened to everyone.

  • How many courses are there in the AI and Algorithm Auditor Certificate Program?

    -There are five courses in the program, each focusing on different core areas central to algorithm auditing.

  • What does the first course of the program cover?

    -The first course covers algorithms, AI, and machine learning, focusing on the technical aspects and how they connect to risk, with some coding in Python.

  • What is the methodology used for ethical risk and impact assessments in the second course?

    -The second course uses a specific methodology developed by Babel for conducting ethical risk and impact assessments for algorithms.

  • What does the third course focus on?

    -The third course focuses on AI governance and risk management, providing a conceptual backbone for navigating various risk management frameworks.

  • What is the purpose of the fourth course in the program?

    -The fourth course deals with bias, accuracy, and the statistics of AI testing, focusing on constructing and testing metrics for AI systems.

  • How does the fifth course relate to the company's operations?

    -The fifth course is specific to the company's operations, focusing on how to audit algorithms, the standards used, and the policies and procedures around the AI Assurance framework.

  • What is the significance of the students graduating from the program?

    -The graduation of students is significant as it indicates that there is a growing workforce capable of working in the AI assurance space, especially as laws like the Digital Services Act come into effect and auditing firms increase their focus on AI assurance.

Outlines

00:00

🎉 Welcome Back to Season 2!

The speaker greets the audience and expresses excitement for the return of the show after a busy period. They mention the Digital Services Act coming into force and the EU AI Act being in the trialogue process. The focus will be on generative AI, its testing, governance, and interviews with experts. The speaker reflects on their recent work, particularly on audits related to New York City local law 144 and the EU AI Act, despite it not being finalized. They highlight the AI and Algorithm Auditor Certificate Program, which was developed to address a skills gap and has now been opened up to the public, with some participants already certified.

05:00

📚 AI Auditor Training Program Overview

The speaker provides an in-depth look at the AI and Algorithm Auditor Certificate Program, which consists of five courses. The courses cover AI and machine learning, algorithmic risk and impact assessments, AI governance and risk management, bias and accuracy in AI testing, and algorithm auditing and assurance. The program aims to equip auditors with the technical and ethical knowledge to assess AI systems, focusing on risk management and governance frameworks. The speaker shares their enthusiasm for the program's success and the potential job opportunities in AI assurance as laws like the Digital Services Act come into effect.

Mindmap

Keywords

💡Digital Services Act

The Digital Services Act (DSA) is a piece of European Union legislation aimed at regulating digital services within the EU. It is designed to ensure a safer online environment and to set clear responsibilities for online platforms. In the video, the DSA is mentioned as a significant development that has come into force, indicating its importance in the digital services landscape and its potential impact on the topics discussed in the series.

💡EU AI Act

The EU AI Act refers to a proposed legislation by the European Union that aims to regulate artificial intelligence within the EU. It is currently in the trialogue process, which means it is being discussed and negotiated between the European Parliament, the Council of the EU, and the European Commission. The video highlights the EU AI Act as a crucial topic of interest, even though it has not yet been finalized or come into effect, showing its relevance to the field of AI governance and ethics.

💡Generative AI

Generative AI refers to artificial intelligence systems that can create new content, such as text, images, or music. These systems use algorithms to learn from existing data and then generate new outputs that are similar to the training data. In the context of the video, generative AI is mentioned as a dominant topic in recent headlines, suggesting that it is a significant area of focus and discussion within the AI community and the media.

💡Algorithm Audits

Algorithm audits involve the evaluation and inspection of algorithms to ensure they are functioning as intended and not causing unintended harm or bias. In the video, the speaker's company has been working on audits related to New York City local law 144 and the EU AI Act, indicating that algorithm audits are a key part of their work in ensuring responsible AI practices and compliance with regulations.

💡AI and Algorithm Auditor Certificate Program

This is a training program mentioned in the video that aims to equip individuals with the skills necessary to audit AI algorithms responsibly. The program includes five courses covering various aspects of AI, risk assessment, governance, and ethics. The speaker expresses gratification at seeing the program's success, with participants now becoming certified AI and algorithm auditors.

💡Algorithmic Risk and Impact Assessments

This refers to the process of evaluating the potential risks and impacts that algorithms may have on individuals or society. The video mentions a specific methodology developed by the speaker's company for conducting ethical risk and impact assessments, which is a core component of their training program. This process is crucial for understanding and mitigating the negative effects of AI systems.

💡AI Governance and Risk Management

AI governance involves the development and implementation of policies, practices, and standards to ensure that AI systems are developed and used responsibly. Risk management, in this context, refers to the strategies and frameworks used to identify, assess, and mitigate risks associated with AI. The video discusses a course that provides a conceptual understanding of these frameworks, which is essential for navigating the complex landscape of AI risk management.

💡Bias, Accuracy, and Statistics of AI Testing

These terms relate to the evaluation of AI systems to ensure they are fair, accurate, and perform well. Bias in AI refers to the tendency of algorithms to produce outcomes that unfairly favor or disadvantage certain groups. Accuracy is a measure of how well an AI system can make correct predictions or decisions. Statistics of AI testing involve the use of statistical methods to assess the performance and reliability of AI models. The video emphasizes the importance of these concepts in the technical courses of the AI and Algorithm Auditor Certificate Program.

💡Algorithm Auditing and Assurance

This refers to the specific process of examining and verifying the integrity and effectiveness of algorithms, particularly in the context of ensuring compliance with standards and regulations. The video mentions a course that focuses on the standards and procedures used by the speaker's company for auditing algorithms, which is a specialized area within the broader field of AI assurance.

💡Lunchtime Babbling

Lunchtime Babbling appears to be the name of the video series or podcast in which the speaker is participating. It is mentioned as returning for a second season, indicating that it is a recurring program with a focus on topics related to AI, digital services, and governance. The speaker invites viewers to like, subscribe, and engage with the content, suggesting an interactive and educational format.

Highlights

Welcome back to Lunchtime Babbling Season 2

Digital Services Act has come into force

EU AI Act is in the trialogue process

Generative AI has dominated the headlines

Focus on generative AI, testing, and governance

Main focus has been on audits for New York City local law 144

Interest in the EU AI Act despite not being in effect

AI and Algorithm Auditor Certificate Program

Problem finding people with required skills for AI auditing

Lack of training material for responsible AI

Training program opened up for everyone due to high interest

First cohort has completed the certification exam

Training consists of five courses

Courses cover AI technical knowledge, risk assessment, governance, bias, and AI auditing

AI Assurance framework and standards discussed

Big companies like the big four auditing firms are entering the AI assurance market

Lunchtime Babbling Season 2 is excited to explore these topics