GetLastActivePopup

[DllImport("user32.dll")]
public static extern IntPtr GetLastActivePopup(
   IntPtr hWnd
);

Microsoft documentation: Link