Fix logging logic when in_order is set to True

[yuxinyuan]

What does this PR do?

This PR fix the logging logic when in_order is set to True. Right now, the in_order flag either hangs the program when main_process_only is also set to True, or does nothing when main_process_only is set to False.

A simple code snippet to test (run with accelerate launch --num_processes=2 test.py):

from accelerate import PartialState
from accelerate.logging import get_logger


s = PartialState()

logger = get_logger("accelerate")
in_order = True
main_process_only = False  # True

logger.info(f"[{s.process_index}] Hello, world!", in_order=in_order, main_process_only=main_process_only)
logger.warning(f"[{s.process_index}] Hello, world!", in_order=in_order, main_process_only=main_process_only)
logger.error(f"[{s.process_index}] Hello, world!", in_order=in_order, main_process_only=main_process_only)

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you read the contributor guideline,
  Pull Request section?
• Was this discussed/approved via a Github issue or the forum? Please add a link
  to it if that's the case.
• Did you make sure to update the documentation with your changes? Here are the
  documentation guidelines, and
  here are tips on formatting docstrings.
• Did you write any new necessary tests?

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[BenjaminBossan]

CI is failing because of the str | None type annotation. This syntax has only been added in Python 3.10 but 3.9 is tested. Either you have to use Optional or from __future__ import annotations.

[yuxinyuan]

@BenjaminBossan
Done.

[muellerzr]

Thanks! Overall this looks good to me, however there's logger-related tests which are now failing. Can you modify those tests since our logs differ a bit now?

[yuxinyuan]

@muellerzr I've tried to fix the tests. Would you please take a look. Thanks!