How to use eval_on_selector_all method in Playwright Python

Best Python code snippet using playwright-python

main.py

Source:main.py

...77        await page.wait_for_timeout(1000)78        items: List[Dict[str, Any]] = []79        if input.is_exact is True:80            # loop through the items and try to match the name81            titles = await page.eval_on_selector_all(82                '//div[@class="buy-box"]/div[@class="left"]/p',83                '(boxes) => boxes.map(box => box.innerText)',84            )85            distances = [distance(input.query, x) for x in titles]86            item_matches = sorted(zip(titles, distances, range(1, len(titles) + 1)), key=lambda x: x[1])87            print(item_matches)88            if len(item_matches) > 0:89                # select the closest one90                button_selector = f'(//div[@class="buy-box"])[{item_matches[0][2]}]/*[contains(@class, "button")]'91                button_class_dict: Dict[str, str] = await page.eval_on_selector(92                    button_selector,93                    '(button) => button.classList',94                )95                if 'custom' not in button_class_dict.values():96                    # just click on the button97                    await page.click(button_selector, click_count=input.quantity)98                    item_title = await page.eval_on_selector(99                        '(//div[@class="buy-box"])[1]/div[@class="left"]/p',100                        '(title) => title.innerText',101                    )102                    items.append({'name': item_title, 'quantity': input.quantity})103                else:104                    # go into customization105                    await page.click(button_selector)106                    await page.wait_for_timeout(500)107                    # get the first sub-item108                    item_title = await page.eval_on_selector(109                        '(//h1[@class="title"])[1]',110                        '(title) => title.innerText',111                    )112                    await page.fill('//input[contains(@class, "count")]', str(input.quantity))113                    await page.wait_for_timeout(500)114                    await page.click('button.to-cart')115                    await page.wait_for_timeout(1000)116                    await page.goto('https://mcd.cn/product')117                    # await page.click('div:text("é¤åèå")')118                    items.append({'name': item_title, 'quantity': input.quantity})119        else:120            result_count = await page.eval_on_selector_all(121                '//div[@class="buy-box"]/div[@class="left"]/p',122                '(boxes) => boxes.length',123            )124            # pick one at random125            item_idx = random.sample(range(1, result_count + 1), input.quantity)126            for idx in item_idx:127                button_selector = f'(//div[@class="buy-box"])[{idx}]/*[contains(@class, "button")]'128                button_class_dict: Dict[str, str] = await page.eval_on_selector(129                    button_selector,130                    '(button) => button.classList',131                )132                if 'custom' not in button_class_dict.values():133                    # just click on the button134                    await page.click(button_selector, click_count=1)135                    item_title = await page.eval_on_selector(136                        '(//div[@class="buy-box"])[1]/div[@class="left"]/p',137                        '(title) => title.innerText',138                    )139                    items.append({'name': item_title, 'quantity': 1})140                else:141                    # go into customization142                    await page.click(button_selector)143                    await page.wait_for_timeout(500)144                    # get the first sub-item145                    item_title = await page.eval_on_selector(146                        '(//h1[@class="title"])[1]',147                        '(title) => title.innerText',148                    )149                    await page.fill('//input[contains(@class, "count")]', '1')150                    await page.wait_for_timeout(500)151                    await page.click('button.to-cart')152                    await page.wait_for_timeout(1000)153                    items.append({'name': item_title, 'quantity': 1})154                    # await page.click('div:text("é¤åèå")')155                    await page.goto('https://mcd.cn/product')156                    await page.wait_for_timeout(2000)157                    await page.fill('//input[contains(@placeholder, "æå¤")]', input.query)158                    await page.click('button.ant-input-search-button')159                    await page.wait_for_timeout(1000)160        state = 'ordered'161        metadata = {'items': items}162        sessions[session_id] = (session, browser, page, state)163        return SessionOutput(id=session_id, state=state, metadata=metadata)164    except KeyError:165        raise HTTPException(state_code=404, detail='session not found')166@app.post('/sessions/{session_id}/cart/clear', response_model=SessionOutput)167async def clear_session_cart(session_id: str):168    try:169        session, browser, page, state = sessions[session_id]170        await page.click('//div[@class="car"]')171        await page.wait_for_timeout(500)172        await page.click('span:text("æ¸ç©ºè´ç©è½¦")')173        await page.wait_for_timeout(500)174        await page.click('//div[@class="ant-popover-buttons"]/button[contains(@class, "ant-btn-primary")]')175        state = 'cart_cleared'176        sessions[session_id] = (session, browser, page, state)177        return SessionOutput(id=session_id, state=state)178    except KeyError:179        raise HTTPException(state_code=404, detail='session not found')180@app.get('/sessions/{session_id}/cart', response_model=SessionOutput)181async def get_session_cart(session_id: str):182    try:183        session, browser, page, state = sessions[session_id]184        cart_price_texts = await page.eval_on_selector_all(185            '//div[@class="price-info"]/span',186            '(spans) => spans.map((span) => span.innerText)',187        )188        address_texts = await page.eval_on_selector_all(189            '//div[@class="othpart address"]/div[@class="center"]/div',190            '(spans) => spans.map((span) => span.innerText)',191        )192        deliver_time_texts = await page.eval_on_selector_all(193            '//div[@class="othpart time"]/div[@class="center"]/div',194            '(spans) => spans.map((span) => span.innerText)',195        )196        checkout_button_class_dict: Dict[str, str] = await page.eval_on_selector(197            '//button[contains(@class, "to-check")]',198            '(button) => button.classList',199        )200        if 'grey' in checkout_button_class_dict.values():201            state = 'cart_empty'202            sessions[session_id] = (session, browser, page, state)203            return SessionOutput(204                id=session_id,205                state=state,206                metadata={207                    'items': [],208                    'cart_price_texts': cart_price_texts,209                    'address_texts': address_texts,210                    'deliver_time_texts': deliver_time_texts,211                },212            )213        else:214            await page.click('//div[@class="car"]')215            await page.wait_for_timeout(500)216            item_titles = await page.eval_on_selector_all(217                '//div[contains(@class, "cart-panel-details")]/div[@class="main"]/div/div/div[@class="name"]',218                '(titles) => titles.map(title => title.innerText)',219            )220            item_quantities = await page.eval_on_selector_all(221                '//div[contains(@class, "cart-panel-details")]/div[@class="main"]/div/div/div[@class="count-panel"]/div/input',222                '(quantities) => quantities.map(q => q.value)',223            )224            await page.wait_for_timeout(500)225            await page.click('//div[@class="close"]')226            state = 'cart_viewed'227            sessions[session_id] = (session, browser, page, state)228            return SessionOutput(229                id=session_id,230                state=state,231                metadata={232                    'items': list(map(lambda item: { "name": item[0], "quantity": item[1] }, zip(item_titles, item_quantities))),233                    'cart_price_texts': cart_price_texts,234                    'address_texts': address_texts,...

test_queryselector.py

Source:test_queryselector.py

...21    page = await context.new_page()22    await page.set_content("<div><span></span></div><div></div>")23    assert await page.eval_on_selector("tag=DIV", "e => e.nodeName") == "DIV"24    assert await page.eval_on_selector("tag=SPAN", "e => e.nodeName") == "SPAN"25    assert await page.eval_on_selector_all("tag=DIV", "es => es.length") == 226    assert await page.eval_on_selector("tag2=DIV", "e => e.nodeName") == "DIV"27    assert await page.eval_on_selector("tag2=SPAN", "e => e.nodeName") == "SPAN"28    assert await page.eval_on_selector_all("tag2=DIV", "es => es.length") == 229    # Selector names are case-sensitive.30    with pytest.raises(Error) as exc:31        await page.query_selector("tAG=DIV")32    assert 'Unknown engine "tAG" while parsing selector tAG=DIV' in exc.value.message33    await context.close()34async def test_selectors_register_should_work_with_path(35    selectors, page: Page, utils, assetdir36):37    await utils.register_selector_engine(38        selectors, "foo", path=assetdir / "sectionselectorengine.js"39    )40    await page.set_content("<section></section>")41    assert await page.eval_on_selector("foo=whatever", "e => e.nodeName") == "SECTION"42async def test_selectors_register_should_work_in_main_and_isolated_world(43    selectors, page: Page, utils44):45    dummy_selector_script = """{46      create(root, target) { },47      query(root, selector) {48        return window.__answer;49      },50      queryAll(root, selector) {51        return window['__answer'] ? [window['__answer'], document.body, document.documentElement] : [];52      }53    }"""54    await utils.register_selector_engine(selectors, "main", dummy_selector_script)55    await utils.register_selector_engine(56        selectors, "isolated", dummy_selector_script, content_script=True57    )58    await page.set_content("<div><span><section></section></span></div>")59    await page.evaluate('() => window.__answer = document.querySelector("span")')60    # Works in main if asked.61    assert await page.eval_on_selector("main=ignored", "e => e.nodeName") == "SPAN"62    assert (63        await page.eval_on_selector("css=div >> main=ignored", "e => e.nodeName")64        == "SPAN"65    )66    assert await page.eval_on_selector_all(67        "main=ignored", "es => window.__answer !== undefined"68    )69    assert (70        await page.eval_on_selector_all(71            "main=ignored", "es => es.filter(e => e).length"72        )73        == 374    )75    # Works in isolated by default.76    assert await page.query_selector("isolated=ignored") is None77    assert await page.query_selector("css=div >> isolated=ignored") is None78    # $$eval always works in main, to avoid adopting nodes one by one.79    assert await page.eval_on_selector_all(80        "isolated=ignored", "es => window.__answer !== undefined"81    )82    assert (83        await page.eval_on_selector_all(84            "isolated=ignored", "es => es.filter(e => e).length"85        )86        == 387    )88    # At least one engine in main forces all to be in main.89    assert (90        await page.eval_on_selector(91            "main=ignored >> isolated=ignored", "e => e.nodeName"92        )93        == "SPAN"94    )95    assert (96        await page.eval_on_selector(97            "isolated=ignored >> main=ignored", "e => e.nodeName"...

TechJuice-xpath-Task.py

Source:TechJuice-xpath-Task.py

...20        Title = quote.query_selector('xpath=div/h2/a').inner_text()21        print('Title : ', Title )22        Description = quote.query_selector('xpath=div/p').inner_text()23        print('Description : ', Description )24        hrefs_of_page = quote.eval_on_selector_all(".text-dark", "elements => elements.map(element => element.href)")25        str=""26        string_format_href = str.join(hrefs_of_page)27        article_url.append(string_format_href)28        print('hrefs_of_page : ', string_format_href )29        dic = {}30        dic['Title','Description','Url'] = Title,Description,string_format_href31        list_dic.append(dic)32        with open('Tech-Juice-xpath.csv', 'a', newline='') as outcsv:33            writer = csv.writer(outcsv)34            writer.writerow([Title,string_format_href,Description])35        print("\n")36      except:37        Title = "Not Found"38        print('Title : ', Title )39        print('Description : ', Description )40        print('hrefs_of_page : ', hrefs_of_page )41      42    print('Article_url : ',article_url)43    page.wait_for_timeout((2000))44    for i in article_url:45      Article_page = browser.new_page()46      Article_page.goto(i)47      page.wait_for_timeout((3000))48      Article_Heading =  Article_page.query_selector('xpath= //html/body/div/div/div/div/div/div/h1').inner_html()49      print('Article_Heading : ',Article_Heading)50      written_by =  Article_page.query_selector('xpath= //html/body/div/div/div/div/div/div/div/small/a/span').inner_html()  51      print("Written By --",written_by)52      # Article_Des =  Article_page.query_selector('xpath= //html/body/div/div/div[2]/div/div/div/article/p/span').inner_html()  53      # print('Article_Description : ',Article_Des)54      # with open('Tech-Juice-xpath.csv', 'a', newline='') as outcsv:55      #       writer = csv.writer(outcsv)56      #       writer.writerow(["","","",written_by,Article_Heading,Article_Des])57      58      Article_page.close()59if __name__ == '__main__':60    main('https://www.techjuice.pk/')61            62# blog = page.query_selector_all('site-content')63# blog = page.query_selector_all('.col-md-9')64# blog = page.  query_selector_all('.site-content > .row > div:first-child .col-md-9')65# blog =  page.query_selector_all('xpath= //html/body/div/div[1]/div/div')  66# # t = quote.query_selector('xpath=div/h2/a[href].href')...

19-list.py

Source:19-list.py

...33    # list_dic = []34    # article_url = []35    # for quote in blog:36    #   # # t = quote.query_selector('xpath=div/h2/a[href].href')37    #   # t = quote.eval_on_selector_all(".text-dark", "elements => elements.map(element => element.href)")38      39    #   try:40    #     Title = quote.query_selector('xpath=div/h2/a').inner_text()41    #     print('Title : ', Title )42    #     Description = quote.query_selector('xpath=div/p').inner_text()43    #     print('Description : ', Description )44    #     hrefs_of_page = quote.eval_on_selector_all(".text-dark", "elements => elements.map(element => element.href)")45    #     str=""46    #     string_format_href = str.join(hrefs_of_page)47    #     article_url.append(string_format_href)48    #     print('hrefs_of_page : ', string_format_href )49    #     dic = {}50    #     dic['Title','Description','Url'] = Title,Description,string_format_href51    #     list_dic.append(dic)52    #     print("\n")53    #   except:54    #     Title = "Not Found"55    #     print('Title : ', Title )56    #     print('Description : ', Description )57    #     print('hrefs_of_page : ', hrefs_of_page )58      ...

Playwright tutorial

LambdaTest’s Playwright tutorial will give you a broader idea about the Playwright automation framework, its unique features, and use cases with examples to exceed your understanding of Playwright testing. This tutorial will give A to Z guidance, from installing the Playwright framework to some best practices and advanced concepts.

Chapters:

What is Playwright : Playwright is comparatively new but has gained good popularity. Get to know some history of the Playwright with some interesting facts connected with it.
How To Install Playwright : Learn in detail about what basic configuration and dependencies are required for installing Playwright and run a test. Get a step-by-step direction for installing the Playwright automation framework.
Playwright Futuristic Features: Launched in 2020, Playwright gained huge popularity quickly because of some obliging features such as Playwright Test Generator and Inspector, Playwright Reporter, Playwright auto-waiting mechanism and etc. Read up on those features to master Playwright testing.
What is Component Testing: Component testing in Playwright is a unique feature that allows a tester to test a single component of a web application without integrating them with other elements. Learn how to perform Component testing on the Playwright automation framework.
Inputs And Buttons In Playwright: Every website has Input boxes and buttons; learn about testing inputs and buttons with different scenarios and examples.
Functions and Selectors in Playwright: Learn how to launch the Chromium browser with Playwright. Also, gain a better understanding of some important functions like “BrowserContext,” which allows you to run multiple browser sessions, and “newPage” which interacts with a page.
Handling Alerts and Dropdowns in Playwright : Playwright interact with different types of alerts and pop-ups, such as simple, confirmation, and prompt, and different types of dropdowns, such as single selector and multi-selector get your hands-on with handling alerts and dropdown in Playright testing.
Playwright vs Puppeteer: Get to know about the difference between two testing frameworks and how they are different than one another, which browsers they support, and what features they provide.
Run Playwright Tests on LambdaTest: Playwright testing with LambdaTest leverages test performance to the utmost. You can run multiple Playwright tests in Parallel with the LammbdaTest test cloud. Get a step-by-step guide to run your Playwright test on the LambdaTest platform.
Playwright Python Tutorial: Playwright automation framework support all major languages such as Python, JavaScript, TypeScript, .NET and etc. However, there are various advantages to Python end-to-end testing with Playwright because of its versatile utility. Get the hang of Playwright python testing with this chapter.
Playwright End To End Testing Tutorial: Get your hands on with Playwright end-to-end testing and learn to use some exciting features such as TraceViewer, Debugging, Networking, Component testing, Visual testing, and many more.
Playwright Video Tutorial: Watch the video tutorials on Playwright testing from experts and get a consecutive in-depth explanation of Playwright automation testing.