feat:Alignment during recontruction of image

[SkaarFacee]

No description provided.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 96.40%. Comparing base (1cea7d8) to head (b912996).
Report is 18 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1657      +/-   ##
==========================================
+ Coverage   96.35%   96.40%   +0.04%     
==========================================
  Files         164      164              
  Lines        7773     7780       +7     
==========================================
+ Hits         7490     7500      +10     
+ Misses        283      280       -3     

Flag	Coverage Δ
unittests	96.40% <100.00%> (+0.04%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[felixdittrich92]

Hi @SkaarFacee 👋,

Thanks for the PR.

[felixdittrich92]

I would suggest the following:

def synthesize_page(
    page: Dict[str, Any],
    draw_proba: bool = False,
    font_family: Optional[str] = None,
    adjust_to_line: bool = False,
) -> np.ndarray:
    """Draw a the content of the element page (OCR response) on a blank page.

    Args:
    ----
        page: exported Page object to represent
        draw_proba: if True, draw words in colors to represent confidence. Blue: p=1, red: p=0
        font_size: size of the font, default font = 13
        font_family: family of the font
        adjust_to_line: if True, adjust y coordinates to line geometry

    Returns:
    -------
        the synthesized page
    """
    # Draw template
    h, w = page["dimensions"]
    response = 255 * np.ones((h, w, 3), dtype=np.int32)

    # Draw each word
    for block in page["blocks"]:
        multiline = len(block["lines"]) > 1
        for line in block["lines"]:
            for word in line["words"]:
                # Get absolute word geometry
                (xmin, ymin), (xmax, ymax) = word["geometry"]
                xmin, xmax = int(round(w * xmin)), int(round(w * xmax))

                if multiline and adjust_to_line:
                    ymin = int(round(h * line["geometry"][0][1]))
                    ymax = int(round(h * line["geometry"][1][1]))
                else:
                    ymin, ymax = int(round(h * ymin)), int(round(h * ymax))

In this case the user can still decide and adjusting makes only sense if we have lines (so resolve_lines=True)

[SkaarFacee]

Okay, I will do that right away

[felixdittrich92]

This does still not work well see:

• does still overlap

[SkaarFacee]

That is interesting. I shall debug this and see why the issue exists

[SkaarFacee]

Hey there, what models did you use for these?

[felixdittrich92]

Hey :)

fast_base and parseq and db_mobilenet_v3_large and crnn_mobilenet_v3_large

[felixdittrich92]

#1750