Good afternoon, and thank you for joining us for this session. My name is Michelle Soltis, and I have the distinct pleasure of welcoming Mr. Kevin Patrick to the conference's virtual stage today. Mr. Patrick joined the American Board of Preventive Medicine in 2017, and currently holds the role of Continuing Certification Manager. In his role, he is responsible for the overall management of the Board's transition from the current Maintenance of Certification Program to the new and innovative Continuing Certification Program. At the conclusion of this afternoon's presentation, you will be able to define the objective of the transition from the current Maintenance of Certification Program to the new Continuing Certification Program, and to identify both the requirements for diplomats who do not activate their ABPM account and register for the Maintenance of Certification activities, and the impact on diplomats currently in the recertification cycle. You will also be able to describe the Board's Longitudinal Assessment Program Pilot. So without further ado, please let's welcome Mr. Kevin Patrick. Thank you, Dr. Soltis, and thank you everyone for joining us today where we will provide you with an update on the American Board of Preventive Medicine's Maintenance of Certification Program. As Dr. Soltis noted, I am Kevin Patrick and I am the American Board of Preventive Medicine's Continuing Certification Manager. So the ABPM is currently in the process of transitioning to our new Continuing Certification Program, and the American Board of Medical Specialties Vision Commission Report recommends that boards move away from high-stakes examinations and replaces them with longitudinal assessment components, supported further by flexible and relevant practice enhancement modules coupled with CME requirements. So that is the current project or things we're working on here at the ABPM is this big transitional period, and today we're going to be going through and talking about how those changes impact your current certification cycle. ABMS is scheduled to release Continuing Certification Standards by the third quarter of 2021. Once the American Board of Medical Specialties releases their Continuing Certification Standards, the ABPM will work with its stakeholders to develop a flexible and relevant Continuing Certification Program. That will best meet the needs of the ABPM diplomate population. The ABPM's transition from current maintenance certification program to the new Continuing Certification Program can be quite tricky. So to try and streamline this transition and to make this more understandable for our diplomate population, the ABPM has created a transitional plan. The transitional plan is provided to diplomates to be a thoughtful, simple, well-organized, and orderly transition from the current maintenance and certification requirements to the more flexible and relevant requirements of the new Continuing Certification Program. The transitional period began on February 1st of 2020 and will continue through December 31st of 2022. Before we get into the specific components of the transitional MOC period and how that is going to impact your certification, I wanted to provide you some information about what the ABPM is doing in response to the COVID-19 pandemic. For diplomates who activate their ABPM account and register for maintenance and certification by December 31st of 2021, the ABPM will waive your MOC Part 2 requirements, that being the Continuing Medical Education requirements, your Part 4 requirements, the Improvement and Medical Practice Activity requirement, and your Patient Safety Course requirements. Again, to qualify for this waiver, you are required to activate your account on the ABPM's website and to register for maintenance and certification by December 31st of 2021. By qualifying for this waiver, your MOC Part 2, 4, and Patient Safety requirements will be waived during the remainder of the transitional period, which again will last through December 31st of 2022. Before we get too excited about the waiver, we do need to understand that some diplomates are not going to qualify for the waiver, and those diplomates are going to be the individuals who do not log into their account and register for maintenance and certification by the end of the year. So, over the next couple of slides, I'm going to provide a little bit more information about what will those requirements be if you do not register your account and sign up for maintenance and certification by the end of this year. The transitional MOC program does consist of four parts, and these four parts remain unchanged from previous maintenance certification requirements. Part 1, Professionalism. Part 2, Lifelong Learning and Self-Assessment. Part 3, Assessment of Knowledge, Judgment, and Skills. And Part 4, Improvement in Medical Practice. So over the coming slides, we'll talk about each of these parts individually, whether or not the waiver will help you in completing these requirements, and what specifically will be required to document compliance with these requirements during the transitional period. So Part 1 is Professionalism. Part 1 remains unchanged from previous maintenance and certification requirements. Diplomates of the ABPM shall at all times maintain a full, valid, and unrestricted license to practice medicine in all states, territories, or jurisdictions for which the diplomate has a license to practice medicine. Again, this requirement remains unchanged. As a diplomate of the ABPM, you are required to maintain an active license to practice medicine, and you can track this information through the Certification section of your Physician Portal on the ABPM's website. Once you log into your account, you can scroll to the Certification section and expand Part 1. That will provide you with information about your current medical licenses, and occasionally we will receive updates from ABMS if you have a new certification or a new license expiration date. You can check those updates at the top of your Physician Portal, and we highly encourage you to accept any of those updates that match your current licensure. If that information is incorrect, you can update this information through the Settings section of your account. Once you log in, you'll see your name in the top right corner of the screen. Simply select your name and click on the Medical License section of your Physician Portal. From there, you can enter up-to-date information about your medical license. Part 2 of ABPM's Transitional MOC requirements is the Lifelong Learning and Self-Assessment or Continuing Medical Education component. Diplomates of the ABPM shall, for each calendar year of 2021 and 2022, be required to complete 25 AMA PRA Category 1 credits or their equivalent. Diplomates may use any combination of Lifelong Learning and Self-Assessment credits. Those are the special credits you receive from partner specialty societies following your participation in those sessions, or any general AMA PRA Category 1 credits. Again, if you qualify for the COVID-19 waiver, you are exempt from this requirement. If you are not exempt from this requirement, you can document compliance with this interim CME credit requirement through your Physician Portal on the ABPM's website. When you log into your Physician Portal, you can scroll to the Certification section, expand Part 2, and select the CME Attestation icon. Once you select that icon, it'll bring you to this screen where you'll have two options. The first option is to submit a single attestation of compliance with the 25 credit requirement for the calendar year. If you would like to track the individual sessions you completed throughout the year, maybe this is for your state licensing requirements, or maybe if you would just like to keep a repository of all credits you've completed, you can feel free to do so using the Enter Credits Manually icon. By selecting that, you'll have the opportunity to provide specific information about each continuing medical education credit you've received, as well as attach any sort of certificates that you would like to submit as confirmation of CME credits earned. The ABPM will audit up to 5% of the diplomate population who is subject to the CME credit requirement during the transitional period. Again, if you qualify for the waiver, you do not need to worry about Part 2 CME credit requirement, for that is waived during the transitional period. Part 3 of the ABPM's transitional MOC requirements is the Assessment of Knowledge, Judgment, and Skills component. Diplomates whose 10-year certification cycle ends on or before January 31st of 2023 must take and pass the MOC exam for the specialty and or subspecialty for which recertification is being sought prior to certification expiration. So if you're a diplomate whose certificate expires at any time between now and January 31st of 2023, you must take and pass the MOC exam to recertify your board certification. Registration for the maintenance certification exam may be submitted through your physician portal on the ABPM's website. If you are a diplomate who has a certificate that expires beyond January 31st of 2023, you are not required to take the high stakes maintenance certification exam. However, you are required to enroll and begin participating in the ABPM's new continuing certification program, which is scheduled to launch in 2023, and participate in the new longitudinal assessment component, which we anticipate will launch in Q1 of 2024. For diplomates subject to the high stakes MOC exam, the ABPM is pleased to offer two options. Diplomates may choose to take the online remotely proctored MOC exam or register for an in-person administration. These are offered throughout the calendar year. As you can see, the in-person exams unfortunately have mostly been canceled this year in response to COVID-19, but dates for 2022 in-person MOC exam administrations will be released on the ABPM's website in the first quarter of 2022. As for the online or remotely proctored MOC exam, the ABPM has several administrations throughout the year, and registration may be submitted through your position portal. In the event you register for an exam in July, and once you're closer to the exam registration deadline or once you're close to taking the exam and you think, I'm not ready, maybe I need some more time, you can always update your exam registration to a later registration date. So, if you log into the ABPM's website and you're interested in registering for any of these exams, you may do so again through your physician portal. If you have any questions about registering or taking the remotely proctored MOC exam, please do not hesitate to contact me and I would be happy to provide you with additional information. The ABPM's Part 4 component is the Improvement and Medical Practice Activity component. This can always be a tricky, I think, component of the maintenance certification program, and I think the important thing I would like to communicate to you during this session is that the ABPM, again, has waived this requirement for qualified diplomates. If you do not qualify for the waiver, the ABPM will not track this component of the ABPM's MOC program during the transitional period. So, if you do not qualify for the waiver, but you do not complete an activity during the transitional period, the ABPM will not penalize you for not completing the activity. That being said, we would like to incentivize our diplomates to complete Improvement and Medical Practice activities because we do think they provide value. So, what we're doing during the transitional period, if you complete your Improvement and Medical Practice activity with one of our partner specialty societies during the transitional period, that being between February 1st of 2020 and December 31st of 2022, you will not only receive current credit for completing an activity, you will also receive credit for the first Improvement and Medical Practice activity requirement in the future Continuing Certification Program. So, by completing an IMP activity now, you'll fulfill the requirement through December 31st of 2027. So, that's a pretty good time span to fulfill this requirement, and we hope that our diplomates will take advantage of this extended period of fulfilling the requirement. Similar to the CME credit requirement, diplomates will attest to compliance with the Part IV IMP requirement through their physician portal. Once you are logged into your account, you'll simply scroll to the certification section, select IMP attestation, and it'll bring you to this screen where you can provide additional information about the activity you completed. The ABPM will continue to receive confirmation of approval from the partner specialty societies, so that way we can ensure that this credit is applied to your next requirement in the new Continuing Certification Program. So, if you don't feel comfortable submitting the attestation for Part IV, that's no problem. I'm happy to go in there and do that for you. If you're interested in submitting the attestation, I encourage you to log into your account and take a look. It's a pretty great feature that we've implemented over the past year. The final transitional MOC requirement is the patient safety course requirement. All diplomates of the ABPM are required to complete a patient safety course on or before February 1st of 2023. Diplomates may complete the patient safety course or may fulfill this requirement by having completed an ACGME-accredited residency or fellowship in 2012 or later, or by completing an ABPM-approved patient safety course. The ABPM maintains a list of pre-approved courses on its website, and we also have the criteria of a patient safety course that we will accept. So if you've completed a patient safety course for your employer or for your state licensing requirements and it meets those criteria, you can document that in your physician portal and it will fulfill your patient safety course requirement. If you are a diplomate who qualifies for the waiver, you are not required to complete a patient safety course during the transitional period. And once again, this will be submitted through the attestation form, similar to Parts 2 and 4. So when you log into your account, scroll into the certification section and expand Part 2, there will be a blue icon that says patient safety course attestation, so you can document completion of this course through your portal as well. So how do all of these changes impact our diplomates who are currently in cycle? On the ABPM's website, under the transitional MOC section, we have provided links to each of the major certification expiration dates. So you can log onto the ABPM's website and find the date most closely aligned or associated with your certification expiration date. By clicking that, you will see the two options, whether you qualify for the waiver or you don't qualify for the waiver, and it will outline your specific requirements during this transitional period. Alternatively, if you simply log into your account on the ABPM's website, it will tell you exactly what is required of you during this transitional period. Additionally, it will let you know if you have qualified for the waiver and if those requirements are waived through December 31st of 2022. So I highly encourage you to log in directly to your physician portal to see how the transitional MOC requirements impact your certification. So now we're going to move on to ABPM's Longitudinal Assessment Program Pilot for Clinical Informatics. This is a program that we are very excited to offer our diplomates, and kind of a lot of diplomates have the question, what is longitudinal assessment? How is this different than a high-stakes MOC exam? Well, longitudinal assessment is shorter, more frequent assessments over a period of time. Some content may be repeated to reinforce important concepts. So if you are completing items in the assessment and you get that item incorrect, the next segment you might see the same or a similar item to see if you have addressed the knowledge gap that you identified in that first segment. So we're able to really document and track what questions you're answering correctly, what content areas you might be having issues with, and help you to address those content area deficiencies moving forward. Longitudinal assessment uses proven adult learning principles, and it emphasizes learning over point-in-time high-stakes testing. So this isn't meant to be a high-stress situation where you sit down for two hours and answer a hundred questions, and the status of your board certification is dependent on you passing that exam. This is really something that's going to take place over time, and we want our diplomates to feel engaged with the board. We want you to feel like you're getting something back from this assessment component, and really learning. So that is the entire focus of longitudinal assessment. Participants answer questions online, so there's no need to travel to a point-in-time high-stakes exam. You can complete this in the comforts of your home or office, and the pilot program is actually accessible to our diplomates on their phones, computers, and tablets. So a lot of our diplomates are completing the assessment on the go. And you can find some more information about the principles and research behind longitudinal assessment on the ABMS's website. They actually have an entire section of their site dedicated to longitudinal assessment, and I definitely recommend visiting that section of the website for more information. So why are we considering longitudinal assessment? Well, in 2019, I previously mentioned that ABMS released their vision for the future commission report, and that report recommended that all ABMS member boards implement longitudinal assessment. To support that, in 2019, the ABPM conducted a survey of the diplomate population, and 77% of diplomate respondents preferred longitudinal assessment over a single point-in-time high-stakes exam administered every 10 years. Longitudinal assessment will also allow diplomates to identify their own knowledge gaps and direct their educational efforts effectively. So we think there are a lot of positive components to a longitudinal assessment program, and we're very excited to offer this as an opportunity to our diplomates moving forward. So the pilot program is only going to be available for our diplomates certified in the subspecialty of clinical informatics. Unfortunately, if you are certified in a specialty or subspecialty other than clinical informatics, you will not be able to participate in the pilot program. And the pilot program began on April 1st of 2021. It will run for 24 consecutive months, and we've divided it into four six-month testing sessions. So the first session is April 3rd, September of 2021, October 2021 to March of 22, April 21, September 22, and October 22 to March of 2023. During each of those six-month sessions, our diplomate participants will answer 12 multiple-choice questions. They will answer questions through the assessment platform, which they can navigate to through their physician portal on the ABPM's website, and they can answer questions at any time during the six-month testing window. Our diplomates can answer one question at a time, they can answer all questions at once, or any other frequency in between. Participants are allowed to use references. It's an open book, open reference assessment. However, they are not permitted the ability to confer with their colleagues or peers to answer any of these items. Additionally, incorrect and unanswered items are marked incorrect and therefore they will be taken into consideration for the overall score. So how will the ABPM score the pilot program? The system itself will calculate a participant's score based on the number of questions answered correctly overall and in each content area. ABPM and its subject matter experts will review a full psychometric analysis to determine a performance standard and a passing score. And during the pilot phase, diplomats who fully participate but do not achieve a passing score will not be penalized for failing to achieve a passing score. We're really using this as an opportunity to gain feedback from our diplomat population on what they like about the assessment, what do they not like, and what can be approved before we do a full-scale implementation in 2024. One of the best, or I think one of the most amazing things about longitudinal assessment is that after each answered item, the diplomat is provided with the correct answer, a critique or a reference for the answer, as well as a reference and support of the correct answer. So diplomats are able to, in real time, know if they scored correctly on the item and also have additional information to support learning. So participants will be able to view their individual performance on the items and then at the end of the session they will be able to review their performance across all content areas and find out how they are performing compared to their peers. We will work with our partner specialty societies to provide relevant educational activities for those knowledge gaps identified during the assessment program. So now we're going to show you just a really brief video about what our longitudinal assessment program pilot looks like and give you a better understanding of how our diplomats are able to navigate through the assessment platform. Hello, Chris Bell here, Marketing Director at Self Study. As you may know by now, your leadership team from the American Board of Preventive Medicine has selected our Self Study platform to power your longitudinal assessment programs. As pioneers in delivering this kind of continuous assessment since 2015, we're excited about this new partnership with the ABPM and so glad we're kicking it off today at your annual Stakeholder Summit meeting. In the interest of getting everyone off to a great start, we've prepared a short introductory video for all diplomates planning to start using the system right away. If you have any comments or questions after starting on these assessments, please don't hesitate to reach out to our very capable support team via the email address shown on your screen right now, abpm.selfstudyplus.zohodesk.com. There's also a support link in the product as well. And thanks for putting your trust in Self Study for this all-important online assessment project. Here's how it works. To access the ABPM Diplomate site, go to abpm.selfstudy.ai in Google Chrome, Edge, or Safari. When you reach the site, this is the first page you will see. To access the site, click on the start answering questions button. On this page, enter in your username, which is your email, and your password. Once you've done this, click on the login button at the bottom of the panel. The first page you'll see after logging in is the assessments page. On this page, you'll see two cards, one for orientation, which will help you get started navigating and using the Diplomate site, and another card for the longitudinal assessment that you've been assigned to. In this demo, let's click on the card for the longitudinal assessment. On this page, I'll see an overview of my progress throughout the assessment. I haven't answered any questions in the assessment yet, which is why my performance is zero. I have no finished activities and no last access date. To begin answering questions in the first segment, I'll just click on the answer questions button. Before every question is a warning, letting me know that the question is timed, and letting me know that by clicking on the start question button, I agree to ABPM's policy on unprofessional examination behavior. If I'm okay with this, I'll click on the start questions button. If I'm not, then I'll click on the exit button. Once I click on the start questions button, the timer begins and I'm shown the question. I can see the stem and all the answer options available to me. To select an answer, I will just click on one of the answer options available. To change my selection, I'll click on another answer option. I can change my selected answer up until the timer runs out, or I submit an answer. I can submit my answer by clicking on the submit button at the bottom of the answer list. Once I do this, I'm presented with a confidence question. This basically asks me how confident I am in the answer that I selected. There are three options available to me, very confident, somewhat confident, and not confident. To report my confidence level, I'll just click on one of the answers. Next, I'm presented with a relevance question, and this asks me to assess how relevant the assessment item was to my practice. There are three options available to me, very relevant, somewhat relevant, and not relevant. To submit an answer, I'll just click on it. Once the relevancy question is answered, I'm presented with the explanation and the references for the question. I'm also shown whether my answer was correct or not. Some references have links in them. Clicking on a link will open up the linked page in a new tab. I can add a question to my favorites by clicking on the heart icon in the bottom left. I remove it by clicking on the heart icon again. I can positively rate a question by clicking on the thumbs up icon. I can negatively rate a question by clicking on the thumbs down icon, and I can leave feedback for a question by clicking on the dialogue icon. To add text, I'll click in the message area, add my message, and click on the send button to send it, or I can click on the cancel button if I've changed my mind. There's also a calculator available. I can use a calculator by clicking on the calculator icon in the top right corner of the page. To close a calculator, I'll click on the calculator icon again. Now, I'll click on the next button at the bottom of the page to go to the next question. Keep in mind that if you do not submit an answer for a question within the time allotted, that question will be marked as incorrect. Now, let's exit the question page. As you can see, my performance has been updated. My performance is 50% because I answered 1 out of 2 questions correctly. I have finished 2 out of 19 activities, and the last access date is March 30th, 2021. If I want to return to the assessment for segment 1, I'll click on the continue button. Let's take a look at the My History page. To get there, I'll click on the hamburger menu in the top left corner and select History. On this page, I'll see all the questions that I completed within my assessment. I'll get to see the STEM, the answers available to me, the explanation and references, the answer that I submitted, the correct answer if I answered incorrectly. I'll also be able to see the confidence level I reported for the answer that I submitted, and whether I felt the assessment item was relevant to my area of practice. Next, let's take a look at the My Favorites page. We do that by opening the hamburger menu in the top left corner of the page and selecting Favorites. On the Favorites page, I can see all the questions that I added to my Favorites. I can see the STEM, the answers available to me, the explanation and references, the answer that I submitted, and the correct answer if I answered incorrectly. I can also see the confidence in the answer that I submitted, and whether I felt the assessment item was relevant to my area of practice. If I'm having an issue navigating or otherwise using the Diplomate site, I'll open up the menu in the top right corner of the page and select Help. This will take me to the Help page for the Diplomate site. On this page, I'll see a list of frequently asked questions on how to use the Diplomate site. At the very bottom of the page, I'll see a link to tech support. Clicking on this link will allow me to send an email to tech support to report an issue that I'm having. If I'm done answering questions for the day, I'll open the menu in the top right corner again and select Logout. That's really all there is to it. I want to thank you again for choosing Self Study to power AVPM's online longitudinal assessment program. You can use our systems on your smartphone, computer, or tablet, wherever you may be, and we're always just an email away if you have any further questions. So once again, that was just an overview of the AVPM's longitudinal assessment program pilot. And while only Diplomates certified in clinical informatics are able to participate in the pilot program, AVPM is really excited to release longitudinal assessment across all specialty and subspecialty certifications following the transitional period. So once we launch the continuing certification program in 2023, all of our new Diplomates and old Diplomates will enroll in the new continuing certification program, and then we will launch longitudinal assessment beginning Q1 of 2024. So while you aren't able to participate now, I hope you look forward to participating in 2024. And I appreciate you joining in our session today to discuss updates to the AVPM's maintenance certification program as we transition to the new continuing certification program, as well as listening to some information about the AVPM's new longitudinal assessment program pilot. With that being said, if you have any questions or concerns, you can feel free to contact a member of the AVPM staff at avpm at theavpm.org, and I am happy to open up the session now to the Q&A portion. Dr. Soltis? Thank you so much, Mr. Patrick, for just an excellent, wonderful presentation. Appreciate your remarks. So if you could, do you mind just explaining a little bit about the revised fee structure? So many of our Diplomates are so used to just paying one lump sum when their recertification time comes up, and now it seems we're going to a little bit different of a recertification fee structure, where we're paying a little bit, you know, maybe every year. Could you expand a little bit on that revised fee structure, if you could? Yeah, of course. The AVPM's transition away from the $1,750 exam fee to this new annual MOC annual fee structure was driven in response to the AVPM's survey of the Diplomate population, I believe it was in 2018, where a majority of the Diplomate respondents indicated that they preferred an annual fee structure over that large lump sum payment at the end of their certification cycle. So to accommodate the Diplomate feedback that we received, the AVPM implemented the annual fee structure on January 1st of 2019 for Diplomates certified in our specialties and subspecialties, and then all Diplomates certified in the subspecialty of addiction medicine began paying the annual fee in 2018. This also is more closely aligned with the future of the continuing certification program. So since the AVPM is moving away from that high-stakes exam and moving to this longitudinal assessment component, which requires annual engagement, payment for the annual fee of $175 covers that participation in the AVPM's longitudinal assessment program. So really taking that $1,750, divide it over the 10-year certification cycle that we would normally be paying, and that is now the new annual MOC fee. Great, thank you very much, Mr. Patrick. Appreciate that response. One other question. So it's, it appears as though for those that are engaging in the longitudinal assessment program, that you are able to get almost immediate feedback on your own performance. Will Diplomates also be able to see how they are comparing to others that are engaging in the assessment program? Will you be able to say, ooh, I'm the only one, you know, in the, in the country that got this particular question wrong, or, you know, I'm tracking with my peers? Is there a mechanism for that? So that is going to be built into the longitudinal assessment program. That is not going to be immediate feedback. So if you log in on day one of the assessment going live, and you answer all 12 items, obviously your peer performance is going to be quite low, because I don't know if there are so many Diplomates that I'll be logging in and answering all those questions on day one. But what we're going to do is at the end of the segment, we will be combining all of the performance for individuals in the cohort, and we will be putting that into the assessment platform. So you'll be able to log in and see how you performed on those 12 items, and then compare your performance to your peers on the same 12 items. So that's going to be an important component of our longitudinal assessment program, and something that our Diplomates have indicated they look forward to using once we launch this across all of our specialty and subspecialty certifications. That's great. Thank you very much. And one other question, so this may be more of a history question, but do you have any idea as to why we say or pronounce as Diplomates as opposed to Diplomats of the specialty? That's a great question, and I think there are a lot of people who pronounce it differently. I, when I first joined the board in 2017, that is how I learned how to say it, and that is just how I have heard it pronounced throughout my career here at the ABPM, so I say Diplomate. But I hear Diplomat all the time as well, so I'll have to look into that. I'll have to contact ABMS and see if they have a preferred pronunciation. Thank you, Mr. Patrick. So we have another question. For those who are recertifying the high-stakes exam this year, when do they need to start that longitudinal assessment? Do they get a grace period since they just took the exam? When is the expected time that they will need to participate in that LAP program? So that's a great question, and all of Diplomates will begin participating at the same time in 2024. So we're doing our 24-month pilot at this time, and then once the pilot concludes, we collect feedback from our Diplomate participants, revise the program to make sure it's really meeting the needs of all of our Diplomates. We will launch that in the first quarter of 2024, and all Diplomates will enroll and begin participating at that time, even if they just completed the MOC exam this year. Great, thank you. So it doesn't appear as though we have any other questions at this time, but we can continue to certainly collect questions from our Diplomates or Diplomats and ensure that we get those questions over to you, Mr. Patrick, and perhaps we might be able to have a frequently asked questions section on both of our websites that we may be able to share with our members. Yeah, that would be great. Any additional questions that are received following this session, or if you leave this session and later this week you think of a question you might have regarding your specific maintenance certification requirements, or how this transition impacts you specifically, definitely either reach out to ACPM or myself, and I would be happy to follow up with you and address your questions. Yeah, I look forward to it. Great, well thank you very much again for a terrific presentation this afternoon, Mr. Patrick. We very much appreciate your time. Thank you. Thank you for having me. Take care. Thank you.

Continuing Certification Program

American Board of Medical Specialties

transitional plan

Longitudinal Assessment Program Pilot

clinical informatics

longitudinal assessment

knowledge gaps

immediate feedback

2024