pysummarization & bert-extractive-summarizer‗English‗string.ipynb

{"nbformat":4,"nbformat_minor":0,"metadata":{"colab":{"name":"pysummarization & bert-extractive-summarizer‗English‗string.ipynb","provenance":[],"collapsed_sections":["MOe0--mGfQ5X","Bp3NHmlGhSIe","xJxT0PugnLLb"],"authorship_tag":"ABX9TyNQE2N3HlQIkXNDdU0F+4vZ"},"kernelspec":{"name":"python3","display_name":"Python 3"},"language_info":{"name":"python"},"widgets":{"application/vnd.jupyter.widget-state+json":{"b5fe7dd130a64dfba01b251929442306":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_view_name":"HBoxView","_dom_classes":[],"_model_name":"HBoxModel","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.5.0","box_style":"","layout":"IPY_MODEL_f730b56590b04e9b8b7b22a1fccca273","_model_module":"@jupyter-widgets/controls","children":["IPY_MODEL_adcd084a85a04937853a12295d7db3db","IPY_MODEL_4693d9e0a1614187a0eae83b52fb25a2","IPY_MODEL_3aeabaa99c1b47898567d9054c9a8029"]}},"f730b56590b04e9b8b7b22a1fccca273":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"adcd084a85a04937853a12295d7db3db":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_view_name":"HTMLView","style":"IPY_MODEL_a11d28d5bf8740559d99076ecb0abb14","_dom_classes":[],"description":"","_model_name":"HTMLModel","placeholder":"​","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":"Downloading: 100%","_view_count":null,"_view_module_version":"1.5.0","description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_712144f350704cfea255c58f95169d35"}},"4693d9e0a1614187a0eae83b52fb25a2":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_view_name":"ProgressView","style":"IPY_MODEL_416d89df7d1a459e90578c5c4393134a","_dom_classes":[],"description":"","_model_name":"FloatProgressModel","bar_style":"success","max":571,"_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":571,"_view_count":null,"_view_module_version":"1.5.0","orientation":"horizontal","min":0,"description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_86e8ee19db5b46f9a9f8516818328885"}},"3aeabaa99c1b47898567d9054c9a8029":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_view_name":"HTMLView","style":"IPY_MODEL_da302d31b0524483bc08525f9f35ff2e","_dom_classes":[],"description":"","_model_name":"HTMLModel","placeholder":"​","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":" 571/571 [00:00&lt;00:00, 8.38kB/s]","_view_count":null,"_view_module_version":"1.5.0","description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_c94f3f83563e4c05bf90f5aeda92360c"}},"a11d28d5bf8740559d99076ecb0abb14":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"DescriptionStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","_model_module":"@jupyter-widgets/controls"}},"712144f350704cfea255c58f95169d35":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"416d89df7d1a459e90578c5c4393134a":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"ProgressStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","bar_color":null,"_model_module":"@jupyter-widgets/controls"}},"86e8ee19db5b46f9a9f8516818328885":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"da302d31b0524483bc08525f9f35ff2e":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"DescriptionStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","_model_module":"@jupyter-widgets/controls"}},"c94f3f83563e4c05bf90f5aeda92360c":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"0fab533089844864b5c2b08c5aa18ce8":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_view_name":"HBoxView","_dom_classes":[],"_model_name":"HBoxModel","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.5.0","box_style":"","layout":"IPY_MODEL_512d4625dc024b14a28ad6c69fa88a66","_model_module":"@jupyter-widgets/controls","children":["IPY_MODEL_b480db4dd91a476299d79d42b780bc5a","IPY_MODEL_2fd2d51cb5764613880193df6686cd66","IPY_MODEL_1bf5cba23dae4b039a3dbf907e6e3056"]}},"512d4625dc024b14a28ad6c69fa88a66":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"b480db4dd91a476299d79d42b780bc5a":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_view_name":"HTMLView","style":"IPY_MODEL_4897a3999f44434488a6447f858c7fcd","_dom_classes":[],"description":"","_model_name":"HTMLModel","placeholder":"​","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":"Downloading: 100%","_view_count":null,"_view_module_version":"1.5.0","description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_78aaac6af1ab42c4bf309d06c141183e"}},"2fd2d51cb5764613880193df6686cd66":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_view_name":"ProgressView","style":"IPY_MODEL_45bc8d030536455db7d1aed770c583d2","_dom_classes":[],"description":"","_model_name":"FloatProgressModel","bar_style":"success","max":1344997306,"_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":1344997306,"_view_count":null,"_view_module_version":"1.5.0","orientation":"horizontal","min":0,"description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_4304fee4069540dba5ef7acea1564be9"}},"1bf5cba23dae4b039a3dbf907e6e3056":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_view_name":"HTMLView","style":"IPY_MODEL_cb31042aa92e4730a0841e2324a0168e","_dom_classes":[],"description":"","_model_name":"HTMLModel","placeholder":"​","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":" 1.25G/1.25G [00:37&lt;00:00, 37.7MB/s]","_view_count":null,"_view_module_version":"1.5.0","description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_7ae7ed1457344ec8b01f0535080d4b21"}},"4897a3999f44434488a6447f858c7fcd":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"DescriptionStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","_model_module":"@jupyter-widgets/controls"}},"78aaac6af1ab42c4bf309d06c141183e":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"45bc8d030536455db7d1aed770c583d2":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"ProgressStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","bar_color":null,"_model_module":"@jupyter-widgets/controls"}},"4304fee4069540dba5ef7acea1564be9":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"cb31042aa92e4730a0841e2324a0168e":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"DescriptionStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","_model_module":"@jupyter-widgets/controls"}},"7ae7ed1457344ec8b01f0535080d4b21":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"c82597bc882e4437bff3f052c8725879":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_view_name":"HBoxView","_dom_classes":[],"_model_name":"HBoxModel","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.5.0","box_style":"","layout":"IPY_MODEL_824a63c78f9c4522a2bec5f0e0a860b4","_model_module":"@jupyter-widgets/controls","children":["IPY_MODEL_25029363a6234281b689193ebab05a4e","IPY_MODEL_0584928e947f49d69b9e6b1a7358d83f","IPY_MODEL_8c51eff9dd874eb7b9804fe747c6f422"]}},"824a63c78f9c4522a2bec5f0e0a860b4":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"25029363a6234281b689193ebab05a4e":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_view_name":"HTMLView","style":"IPY_MODEL_2357efd8d0394ba9b6df5955dd4ea541","_dom_classes":[],"description":"","_model_name":"HTMLModel","placeholder":"​","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":"Downloading: 100%","_view_count":null,"_view_module_version":"1.5.0","description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_4fadd7bf60a3404eb8395dea8c4fd447"}},"0584928e947f49d69b9e6b1a7358d83f":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_view_name":"ProgressView","style":"IPY_MODEL_0db4926964004c9a92b0e43ce0bd2b76","_dom_classes":[],"description":"","_model_name":"FloatProgressModel","bar_style":"success","max":231508,"_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":231508,"_view_count":null,"_view_module_version":"1.5.0","orientation":"horizontal","min":0,"description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_6ed072b5c65c464dbaa583cc686a8501"}},"8c51eff9dd874eb7b9804fe747c6f422":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_view_name":"HTMLView","style":"IPY_MODEL_d03d8f440aef44da8725779f60d5221d","_dom_classes":[],"description":"","_model_name":"HTMLModel","placeholder":"​","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":" 226k/226k [00:00&lt;00:00, 849kB/s]","_view_count":null,"_view_module_version":"1.5.0","description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_a720f72d1da44827adb087497a6fd2ff"}},"2357efd8d0394ba9b6df5955dd4ea541":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"DescriptionStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","_model_module":"@jupyter-widgets/controls"}},"4fadd7bf60a3404eb8395dea8c4fd447":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"0db4926964004c9a92b0e43ce0bd2b76":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"ProgressStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","bar_color":null,"_model_module":"@jupyter-widgets/controls"}},"6ed072b5c65c464dbaa583cc686a8501":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"d03d8f440aef44da8725779f60d5221d":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"DescriptionStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","_model_module":"@jupyter-widgets/controls"}},"a720f72d1da44827adb087497a6fd2ff":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"fb4e8ce5b705459282f98647715c1b7e":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_view_name":"HBoxView","_dom_classes":[],"_model_name":"HBoxModel","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.5.0","box_style":"","layout":"IPY_MODEL_a3dcac96d8c24241b4647d4353493740","_model_module":"@jupyter-widgets/controls","children":["IPY_MODEL_51c8d7bad9ec49448bd9d08c585cf310","IPY_MODEL_e1e5a835aeab497289f58875d11ae353","IPY_MODEL_7b77cff2324e4d58aa128167fdc7f316"]}},"a3dcac96d8c24241b4647d4353493740":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"51c8d7bad9ec49448bd9d08c585cf310":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_view_name":"HTMLView","style":"IPY_MODEL_d475170006db47cabdb3a7d6dffbaba9","_dom_classes":[],"description":"","_model_name":"HTMLModel","placeholder":"​","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":"Downloading: 100%","_view_count":null,"_view_module_version":"1.5.0","description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_97c127a4ba2545e4879d6f0f3f3bc4e6"}},"e1e5a835aeab497289f58875d11ae353":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_view_name":"ProgressView","style":"IPY_MODEL_4e0921210d17469a9162b7d8e4f0fd6a","_dom_classes":[],"description":"","_model_name":"FloatProgressModel","bar_style":"success","max":28,"_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":28,"_view_count":null,"_view_module_version":"1.5.0","orientation":"horizontal","min":0,"description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_c691c73f6ac1447a935abd794d339731"}},"7b77cff2324e4d58aa128167fdc7f316":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_view_name":"HTMLView","style":"IPY_MODEL_93773d09915b43deb352f4fd79152a52","_dom_classes":[],"description":"","_model_name":"HTMLModel","placeholder":"​","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":" 28.0/28.0 [00:00&lt;00:00, 717B/s]","_view_count":null,"_view_module_version":"1.5.0","description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_fc07f36dc1e64f1c97b7bdbc556a5dc6"}},"d475170006db47cabdb3a7d6dffbaba9":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"DescriptionStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","_model_module":"@jupyter-widgets/controls"}},"97c127a4ba2545e4879d6f0f3f3bc4e6":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"4e0921210d17469a9162b7d8e4f0fd6a":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"ProgressStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","bar_color":null,"_model_module":"@jupyter-widgets/controls"}},"c691c73f6ac1447a935abd794d339731":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"93773d09915b43deb352f4fd79152a52":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"DescriptionStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","_model_module":"@jupyter-widgets/controls"}},"fc07f36dc1e64f1c97b7bdbc556a5dc6":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"298b9025f16a4b14b2df92961a51bf07":{"model_module":"@jupyter-widgets/controls","model_name":"HBoxModel","model_module_version":"1.5.0","state":{"_view_name":"HBoxView","_dom_classes":[],"_model_name":"HBoxModel","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.5.0","box_style":"","layout":"IPY_MODEL_72c5e7fdbeca4ad5b5bfc4fec12faacf","_model_module":"@jupyter-widgets/controls","children":["IPY_MODEL_f99261ce6792459da3ed20c2d7e66c70","IPY_MODEL_e100fb02397a409692b4f8184b0a42bd","IPY_MODEL_a0f958fc24fe4cd5892b7dc0e970cac6"]}},"72c5e7fdbeca4ad5b5bfc4fec12faacf":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"f99261ce6792459da3ed20c2d7e66c70":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_view_name":"HTMLView","style":"IPY_MODEL_241bbd40ddf343c5b1a292cf2cd580fe","_dom_classes":[],"description":"","_model_name":"HTMLModel","placeholder":"​","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":"Downloading: 100%","_view_count":null,"_view_module_version":"1.5.0","description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_280488fafa0b427cb592a76192c76efc"}},"e100fb02397a409692b4f8184b0a42bd":{"model_module":"@jupyter-widgets/controls","model_name":"FloatProgressModel","model_module_version":"1.5.0","state":{"_view_name":"ProgressView","style":"IPY_MODEL_3bf3a5cf9aae4a3aab28bac00291ce79","_dom_classes":[],"description":"","_model_name":"FloatProgressModel","bar_style":"success","max":466062,"_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":466062,"_view_count":null,"_view_module_version":"1.5.0","orientation":"horizontal","min":0,"description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_54ec5c95dbf64fbcb5eb48d288c22f4c"}},"a0f958fc24fe4cd5892b7dc0e970cac6":{"model_module":"@jupyter-widgets/controls","model_name":"HTMLModel","model_module_version":"1.5.0","state":{"_view_name":"HTMLView","style":"IPY_MODEL_ecb02b16d60d4095a7b54b3aeafb74c5","_dom_classes":[],"description":"","_model_name":"HTMLModel","placeholder":"​","_view_module":"@jupyter-widgets/controls","_model_module_version":"1.5.0","value":" 455k/455k [00:00&lt;00:00, 988kB/s]","_view_count":null,"_view_module_version":"1.5.0","description_tooltip":null,"_model_module":"@jupyter-widgets/controls","layout":"IPY_MODEL_e9b00640a2f74dc3bbd3e87ba21e66a3"}},"241bbd40ddf343c5b1a292cf2cd580fe":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"DescriptionStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","_model_module":"@jupyter-widgets/controls"}},"280488fafa0b427cb592a76192c76efc":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"3bf3a5cf9aae4a3aab28bac00291ce79":{"model_module":"@jupyter-widgets/controls","model_name":"ProgressStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"ProgressStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","bar_color":null,"_model_module":"@jupyter-widgets/controls"}},"54ec5c95dbf64fbcb5eb48d288c22f4c":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}},"ecb02b16d60d4095a7b54b3aeafb74c5":{"model_module":"@jupyter-widgets/controls","model_name":"DescriptionStyleModel","model_module_version":"1.5.0","state":{"_view_name":"StyleView","_model_name":"DescriptionStyleModel","description_width":"","_view_module":"@jupyter-widgets/base","_model_module_version":"1.5.0","_view_count":null,"_view_module_version":"1.2.0","_model_module":"@jupyter-widgets/controls"}},"e9b00640a2f74dc3bbd3e87ba21e66a3":{"model_module":"@jupyter-widgets/base","model_name":"LayoutModel","model_module_version":"1.2.0","state":{"_view_name":"LayoutView","grid_template_rows":null,"right":null,"justify_content":null,"_view_module":"@jupyter-widgets/base","overflow":null,"_model_module_version":"1.2.0","_view_count":null,"flex_flow":null,"width":null,"min_width":null,"border":null,"align_items":null,"bottom":null,"_model_module":"@jupyter-widgets/base","top":null,"grid_column":null,"overflow_y":null,"overflow_x":null,"grid_auto_flow":null,"grid_area":null,"grid_template_columns":null,"flex":null,"_model_name":"LayoutModel","justify_items":null,"grid_row":null,"max_height":null,"align_content":null,"visibility":null,"align_self":null,"height":null,"min_height":null,"padding":null,"grid_auto_rows":null,"grid_gap":null,"max_width":null,"order":null,"_view_module_version":"1.2.0","grid_template_areas":null,"object_position":null,"object_fit":null,"grid_auto_columns":null,"margin":null,"display":null,"left":null}}}}},"cells":[{"cell_type":"markdown","metadata":{"id":"MOe0--mGfQ5X"},"source":["# **pysummarization & bert-extractive-summarizer‗English‗string**\n","- pysummarizationは、自然言語処理とニューラルネットワーク言語モデルを用いたPythonのテキスト自動要約ライブラリ。\n","- テキストクラスタリングによって元の文書やウェブスクレイピングされたテキストの主要なポイントをまとめた要約が作成できる。Accel-brain-baseを用いて、LSTMをベースとしたEncoder/Decoderを実装し、Sequence-to-Sequence（Seq2Seq）学習により要約精度を向上させているようだ。\n","- bert-extractive-summarizerは、HuggingFace Pytorch transformersライブラリを利用して、抽出的な要約を実行します。 これは、最初に文を埋め込み、次にクラスタリングアルゴリズムを実行して、クラスターの重心に最も近い文を見つけることで機能します。\n","\n","---\n","- これは <font color= \"LightCoral\">**英文要約専用**</font> です。\n","- **「ランタイム→すべてのセルを実行」**し、ライブラリが読み込まれた後、表示される**[ファイル選択] ボタンをクリックし、要約したいテキストファイル（.txt）指定するだけ**です。\n","- **要約後、result_summary.txt と result_summary.docx を生成**します。[**DeepL翻訳**](https://www.deepl.com/ja/translator) はdocxデータをドラックするだけで翻訳できます。\n","- **要約結果**に「source」「result_summary」「result summary:SL」「\tbert_extra_summary」が表示されます。\n","- SF（SimilarityFilter｜類似性フィルター）：文章内にある文字列に対し類似性の尺度を使って計算し冗長な文章を短くまとめるpysummarizationの機能。カットオフ設定はスライドバーにて設定できます。※設定幅：0.05～0.5（Default=0.25, 0.05Step）\n","- Specified with ratio setting in bert-extractive-summarizer：bert-extractive-summarizerにおける要約ratioの設定です。※設定幅：0.05～0.5（Default=0.2, step:0.05）\n","- <font color= \"LightCoral\">**[注意]**</font> テキストファイルは文字コードを「UTF-8」としてください。\n"]},{"cell_type":"markdown","metadata":{"id":"Bp3NHmlGhSIe"},"source":["# **ライブラリインストール & インポート**"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"PENu1sg2P0f3","executionInfo":{"status":"ok","timestamp":1637834830847,"user_tz":-540,"elapsed":5535,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}},"outputId":"73effd33-bc08-4bcb-c6bc-e9882a0b7ba6"},"source":["pip install pysummarization"],"execution_count":1,"outputs":[{"output_type":"stream","name":"stdout","text":["Collecting pysummarization\n","  Downloading pysummarization-1.1.8.tar.gz (51 kB)\n","\u001b[?25l\r\u001b[K     |██████▍                         | 10 kB 25.7 MB/s eta 0:00:01\r\u001b[K     |████████████▊                   | 20 kB 33.5 MB/s eta 0:00:01\r\u001b[K     |███████████████████             | 30 kB 28.4 MB/s eta 0:00:01\r\u001b[K     |█████████████████████████▌      | 40 kB 20.5 MB/s eta 0:00:01\r\u001b[K     |███████████████████████████████▉| 51 kB 9.5 MB/s eta 0:00:01\r\u001b[K     |████████████████████████████████| 51 kB 268 kB/s \n","\u001b[?25hRequirement already satisfied: numpy in /usr/local/lib/python3.7/dist-packages (from pysummarization) (1.19.5)\n","Requirement already satisfied: nltk in /usr/local/lib/python3.7/dist-packages (from pysummarization) (3.2.5)\n","Requirement already satisfied: six in /usr/local/lib/python3.7/dist-packages (from nltk->pysummarization) (1.15.0)\n","Building wheels for collected packages: pysummarization\n","  Building wheel for pysummarization (setup.py) ... \u001b[?25l\u001b[?25hdone\n","  Created wheel for pysummarization: filename=pysummarization-1.1.8-py3-none-any.whl size=59453 sha256=bde6044382b66d32ef8f479af800684a6039e9ec090ef58a61f5d9756d3f354e\n","  Stored in directory: /root/.cache/pip/wheels/da/14/3e/02d15001af23ca877c5149b66280a605e5cdbbe76972598afa\n","Successfully built pysummarization\n","Installing collected packages: pysummarization\n","Successfully installed pysummarization-1.1.8\n"]}]},{"cell_type":"code","metadata":{"id":"c-uNvmYtP3lX","executionInfo":{"status":"ok","timestamp":1637834830848,"user_tz":-540,"elapsed":7,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}}},"source":["#日本語フォントをインストール\n","#!apt-get -y install fonts-ipafont-gothic"],"execution_count":2,"outputs":[]},{"cell_type":"code","metadata":{"id":"MVB-I5oYSJy6","executionInfo":{"status":"ok","timestamp":1637834830848,"user_tz":-540,"elapsed":6,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}}},"source":["#Mecabのインストール\n","#!pip install mecab-python3==0.996.5"],"execution_count":3,"outputs":[]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"KdxUAZ7g_GfB","executionInfo":{"status":"ok","timestamp":1637834838385,"user_tz":-540,"elapsed":7543,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}},"outputId":"95eddda5-0b7a-4a4d-bfa1-efb0470ebc5b"},"source":["pip install bert-extractive-summarizer"],"execution_count":4,"outputs":[{"output_type":"stream","name":"stdout","text":["Collecting bert-extractive-summarizer\n","  Downloading bert_extractive_summarizer-0.8.1-py3-none-any.whl (19 kB)\n","Requirement already satisfied: scikit-learn in /usr/local/lib/python3.7/dist-packages (from bert-extractive-summarizer) (1.0.1)\n","Collecting transformers\n","  Downloading transformers-4.12.5-py3-none-any.whl (3.1 MB)\n","\u001b[K     |████████████████████████████████| 3.1 MB 8.9 MB/s \n","\u001b[?25hRequirement already satisfied: spacy in /usr/local/lib/python3.7/dist-packages (from bert-extractive-summarizer) (2.2.4)\n","Requirement already satisfied: threadpoolctl>=2.0.0 in /usr/local/lib/python3.7/dist-packages (from scikit-learn->bert-extractive-summarizer) (3.0.0)\n","Requirement already satisfied: joblib>=0.11 in /usr/local/lib/python3.7/dist-packages (from scikit-learn->bert-extractive-summarizer) (1.1.0)\n","Requirement already satisfied: numpy>=1.14.6 in /usr/local/lib/python3.7/dist-packages (from scikit-learn->bert-extractive-summarizer) (1.19.5)\n","Requirement already satisfied: scipy>=1.1.0 in /usr/local/lib/python3.7/dist-packages (from scikit-learn->bert-extractive-summarizer) (1.4.1)\n","Requirement already satisfied: murmurhash<1.1.0,>=0.28.0 in /usr/local/lib/python3.7/dist-packages (from spacy->bert-extractive-summarizer) (1.0.6)\n","Requirement already satisfied: tqdm<5.0.0,>=4.38.0 in /usr/local/lib/python3.7/dist-packages (from spacy->bert-extractive-summarizer) (4.62.3)\n","Requirement already satisfied: requests<3.0.0,>=2.13.0 in /usr/local/lib/python3.7/dist-packages (from spacy->bert-extractive-summarizer) (2.23.0)\n","Requirement already satisfied: blis<0.5.0,>=0.4.0 in /usr/local/lib/python3.7/dist-packages (from spacy->bert-extractive-summarizer) (0.4.1)\n","Requirement already satisfied: cymem<2.1.0,>=2.0.2 in /usr/local/lib/python3.7/dist-packages (from spacy->bert-extractive-summarizer) (2.0.6)\n","Requirement already satisfied: wasabi<1.1.0,>=0.4.0 in /usr/local/lib/python3.7/dist-packages (from spacy->bert-extractive-summarizer) (0.8.2)\n","Requirement already satisfied: setuptools in /usr/local/lib/python3.7/dist-packages (from spacy->bert-extractive-summarizer) (57.4.0)\n","Requirement already satisfied: thinc==7.4.0 in /usr/local/lib/python3.7/dist-packages (from spacy->bert-extractive-summarizer) (7.4.0)\n","Requirement already satisfied: srsly<1.1.0,>=1.0.2 in /usr/local/lib/python3.7/dist-packages (from spacy->bert-extractive-summarizer) (1.0.5)\n","Requirement already satisfied: plac<1.2.0,>=0.9.6 in /usr/local/lib/python3.7/dist-packages (from spacy->bert-extractive-summarizer) (1.1.3)\n","Requirement already satisfied: catalogue<1.1.0,>=0.0.7 in /usr/local/lib/python3.7/dist-packages (from spacy->bert-extractive-summarizer) (1.0.0)\n","Requirement already satisfied: preshed<3.1.0,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from spacy->bert-extractive-summarizer) (3.0.6)\n","Requirement already satisfied: importlib-metadata>=0.20 in /usr/local/lib/python3.7/dist-packages (from catalogue<1.1.0,>=0.0.7->spacy->bert-extractive-summarizer) (4.8.2)\n","Requirement already satisfied: typing-extensions>=3.6.4 in /usr/local/lib/python3.7/dist-packages (from importlib-metadata>=0.20->catalogue<1.1.0,>=0.0.7->spacy->bert-extractive-summarizer) (3.10.0.2)\n","Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.7/dist-packages (from importlib-metadata>=0.20->catalogue<1.1.0,>=0.0.7->spacy->bert-extractive-summarizer) (3.6.0)\n","Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy->bert-extractive-summarizer) (2.10)\n","Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy->bert-extractive-summarizer) (1.24.3)\n","Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy->bert-extractive-summarizer) (2021.10.8)\n","Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy->bert-extractive-summarizer) (3.0.4)\n","Collecting sacremoses\n","  Downloading sacremoses-0.0.46-py3-none-any.whl (895 kB)\n","\u001b[K     |████████████████████████████████| 895 kB 57.8 MB/s \n","\u001b[?25hRequirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.7/dist-packages (from transformers->bert-extractive-summarizer) (21.3)\n","Requirement already satisfied: filelock in /usr/local/lib/python3.7/dist-packages (from transformers->bert-extractive-summarizer) (3.4.0)\n","Collecting pyyaml>=5.1\n","  Downloading PyYAML-6.0-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (596 kB)\n","\u001b[K     |████████████████████████████████| 596 kB 61.2 MB/s \n","\u001b[?25hRequirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.7/dist-packages (from transformers->bert-extractive-summarizer) (2019.12.20)\n","Collecting tokenizers<0.11,>=0.10.1\n","  Downloading tokenizers-0.10.3-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (3.3 MB)\n","\u001b[K     |████████████████████████████████| 3.3 MB 42.4 MB/s \n","\u001b[?25hCollecting huggingface-hub<1.0,>=0.1.0\n","  Downloading huggingface_hub-0.1.2-py3-none-any.whl (59 kB)\n","\u001b[K     |████████████████████████████████| 59 kB 7.5 MB/s \n","\u001b[?25hRequirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.7/dist-packages (from packaging>=20.0->transformers->bert-extractive-summarizer) (3.0.6)\n","Requirement already satisfied: six in /usr/local/lib/python3.7/dist-packages (from sacremoses->transformers->bert-extractive-summarizer) (1.15.0)\n","Requirement already satisfied: click in /usr/local/lib/python3.7/dist-packages (from sacremoses->transformers->bert-extractive-summarizer) (7.1.2)\n","Installing collected packages: pyyaml, tokenizers, sacremoses, huggingface-hub, transformers, bert-extractive-summarizer\n","  Attempting uninstall: pyyaml\n","    Found existing installation: PyYAML 3.13\n","    Uninstalling PyYAML-3.13:\n","      Successfully uninstalled PyYAML-3.13\n","Successfully installed bert-extractive-summarizer-0.8.1 huggingface-hub-0.1.2 pyyaml-6.0 sacremoses-0.0.46 tokenizers-0.10.3 transformers-4.12.5\n"]}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"2UROg66qvU7I","executionInfo":{"status":"ok","timestamp":1637834843631,"user_tz":-540,"elapsed":5259,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}},"outputId":"1d6decc2-98ae-4caa-e19b-e06465038c56"},"source":["pip install python-docx"],"execution_count":5,"outputs":[{"output_type":"stream","name":"stdout","text":["Collecting python-docx\n","  Downloading python-docx-0.8.11.tar.gz (5.6 MB)\n","\u001b[K     |████████████████████████████████| 5.6 MB 6.9 MB/s \n","\u001b[?25hRequirement already satisfied: lxml>=2.3.2 in /usr/local/lib/python3.7/dist-packages (from python-docx) (4.2.6)\n","Building wheels for collected packages: python-docx\n","  Building wheel for python-docx (setup.py) ... \u001b[?25l\u001b[?25hdone\n","  Created wheel for python-docx: filename=python_docx-0.8.11-py3-none-any.whl size=184508 sha256=f0ea7e9e03e6be41ecfbc9c6b0e08eebd392eb9695371b775cff0532f506636a\n","  Stored in directory: /root/.cache/pip/wheels/f6/6f/b9/d798122a8b55b74ad30b5f52b01482169b445fbb84a11797a6\n","Successfully built python-docx\n","Installing collected packages: python-docx\n","Successfully installed python-docx-0.8.11\n"]}]},{"cell_type":"code","metadata":{"id":"wpcToHBZjiIA","executionInfo":{"status":"ok","timestamp":1637834843632,"user_tz":-540,"elapsed":15,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}}},"source":["import pandas as pd\n","import re\n","from docx import Document\n","from docx.shared import RGBColor\n","from docx.shared import Inches\n","from docx.shared import Pt"],"execution_count":6,"outputs":[]},{"cell_type":"code","metadata":{"id":"In8M26dSSR-x","executionInfo":{"status":"ok","timestamp":1637834845087,"user_tz":-540,"elapsed":1469,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}}},"source":["from pysummarization.nlpbase.auto_abstractor import AutoAbstractor\n","from pysummarization.abstractabledoc.top_n_rank_abstractor import TopNRankAbstractor\n","from pysummarization.nlp_base import NlpBase\n","from pysummarization.similarityfilter.tfidf_cosine import TfIdfCosine\n","from pysummarization.tokenizabledoc.simple_tokenizer import SimpleTokenizer"],"execution_count":7,"outputs":[]},{"cell_type":"markdown","metadata":{"id":"hxaLzpUthVYB"},"source":["# **テキスト読込み**"]},{"cell_type":"code","metadata":{"colab":{"resources":{"http://localhost:8080/nbextensions/google.colab/files.js":{"data":"Ly8gQ29weXJpZ2h0IDIwMTcgR29vZ2xlIExMQwovLwovLyBMaWNlbnNlZCB1bmRlciB0aGUgQXBhY2hlIExpY2Vuc2UsIFZlcnNpb24gMi4wICh0aGUgIkxpY2Vuc2UiKTsKLy8geW91IG1heSBub3QgdXNlIHRoaXMgZmlsZSBleGNlcHQgaW4gY29tcGxpYW5jZSB3aXRoIHRoZSBMaWNlbnNlLgovLyBZb3UgbWF5IG9idGFpbiBhIGNvcHkgb2YgdGhlIExpY2Vuc2UgYXQKLy8KLy8gICAgICBodHRwOi8vd3d3LmFwYWNoZS5vcmcvbGljZW5zZXMvTElDRU5TRS0yLjAKLy8KLy8gVW5sZXNzIHJlcXVpcmVkIGJ5IGFwcGxpY2FibGUgbGF3IG9yIGFncmVlZCB0byBpbiB3cml0aW5nLCBzb2Z0d2FyZQovLyBkaXN0cmlidXRlZCB1bmRlciB0aGUgTGljZW5zZSBpcyBkaXN0cmlidXRlZCBvbiBhbiAiQVMgSVMiIEJBU0lTLAovLyBXSVRIT1VUIFdBUlJBTlRJRVMgT1IgQ09ORElUSU9OUyBPRiBBTlkgS0lORCwgZWl0aGVyIGV4cHJlc3Mgb3IgaW1wbGllZC4KLy8gU2VlIHRoZSBMaWNlbnNlIGZvciB0aGUgc3BlY2lmaWMgbGFuZ3VhZ2UgZ292ZXJuaW5nIHBlcm1pc3Npb25zIGFuZAovLyBsaW1pdGF0aW9ucyB1bmRlciB0aGUgTGljZW5zZS4KCi8qKgogKiBAZmlsZW92ZXJ2aWV3IEhlbHBlcnMgZm9yIGdvb2dsZS5jb2xhYiBQeXRob24gbW9kdWxlLgogKi8KKGZ1bmN0aW9uKHNjb3BlKSB7CmZ1bmN0aW9uIHNwYW4odGV4dCwgc3R5bGVBdHRyaWJ1dGVzID0ge30pIHsKICBjb25zdCBlbGVtZW50ID0gZG9jdW1lbnQuY3JlYXRlRWxlbWVudCgnc3BhbicpOwogIGVsZW1lbnQudGV4dENvbnRlbnQgPSB0ZXh0OwogIGZvciAoY29uc3Qga2V5IG9mIE9iamVjdC5rZXlzKHN0eWxlQXR0cmlidXRlcykpIHsKICAgIGVsZW1lbnQuc3R5bGVba2V5XSA9IHN0eWxlQXR0cmlidXRlc1trZXldOwogIH0KICByZXR1cm4gZWxlbWVudDsKfQoKLy8gTWF4IG51bWJlciBvZiBieXRlcyB3aGljaCB3aWxsIGJlIHVwbG9hZGVkIGF0IGEgdGltZS4KY29uc3QgTUFYX1BBWUxPQURfU0laRSA9IDEwMCAqIDEwMjQ7CgpmdW5jdGlvbiBfdXBsb2FkRmlsZXMoaW5wdXRJZCwgb3V0cHV0SWQpIHsKICBjb25zdCBzdGVwcyA9IHVwbG9hZEZpbGVzU3RlcChpbnB1dElkLCBvdXRwdXRJZCk7CiAgY29uc3Qgb3V0cHV0RWxlbWVudCA9IGRvY3VtZW50LmdldEVsZW1lbnRCeUlkKG91dHB1dElkKTsKICAvLyBDYWNoZSBzdGVwcyBvbiB0aGUgb3V0cHV0RWxlbWVudCB0byBtYWtlIGl0IGF2YWlsYWJsZSBmb3IgdGhlIG5leHQgY2FsbAogIC8vIHRvIHVwbG9hZEZpbGVzQ29udGludWUgZnJvbSBQeXRob24uCiAgb3V0cHV0RWxlbWVudC5zdGVwcyA9IHN0ZXBzOwoKICByZXR1cm4gX3VwbG9hZEZpbGVzQ29udGludWUob3V0cHV0SWQpOwp9CgovLyBUaGlzIGlzIHJvdWdobHkgYW4gYXN5bmMgZ2VuZXJhdG9yIChub3Qgc3VwcG9ydGVkIGluIHRoZSBicm93c2VyIHlldCksCi8vIHdoZXJlIHRoZXJlIGFyZSBtdWx0aXBsZSBhc3luY2hyb25vdXMgc3RlcHMgYW5kIHRoZSBQeXRob24gc2lkZSBpcyBnb2luZwovLyB0byBwb2xsIGZvciBjb21wbGV0aW9uIG9mIGVhY2ggc3RlcC4KLy8gVGhpcyB1c2VzIGEgUHJvbWlzZSB0byBibG9jayB0aGUgcHl0aG9uIHNpZGUgb24gY29tcGxldGlvbiBvZiBlYWNoIHN0ZXAsCi8vIHRoZW4gcGFzc2VzIHRoZSByZXN1bHQgb2YgdGhlIHByZXZpb3VzIHN0ZXAgYXMgdGhlIGlucHV0IHRvIHRoZSBuZXh0IHN0ZXAuCmZ1bmN0aW9uIF91cGxvYWRGaWxlc0NvbnRpbnVlKG91dHB1dElkKSB7CiAgY29uc3Qgb3V0cHV0RWxlbWVudCA9IGRvY3VtZW50LmdldEVsZW1lbnRCeUlkKG91dHB1dElkKTsKICBjb25zdCBzdGVwcyA9IG91dHB1dEVsZW1lbnQuc3RlcHM7CgogIGNvbnN0IG5leHQgPSBzdGVwcy5uZXh0KG91dHB1dEVsZW1lbnQubGFzdFByb21pc2VWYWx1ZSk7CiAgcmV0dXJuIFByb21pc2UucmVzb2x2ZShuZXh0LnZhbHVlLnByb21pc2UpLnRoZW4oKHZhbHVlKSA9PiB7CiAgICAvLyBDYWNoZSB0aGUgbGFzdCBwcm9taXNlIHZhbHVlIHRvIG1ha2UgaXQgYXZhaWxhYmxlIHRvIHRoZSBuZXh0CiAgICAvLyBzdGVwIG9mIHRoZSBnZW5lcmF0b3IuCiAgICBvdXRwdXRFbGVtZW50Lmxhc3RQcm9taXNlVmFsdWUgPSB2YWx1ZTsKICAgIHJldHVybiBuZXh0LnZhbHVlLnJlc3BvbnNlOwogIH0pOwp9CgovKioKICogR2VuZXJhdG9yIGZ1bmN0aW9uIHdoaWNoIGlzIGNhbGxlZCBiZXR3ZWVuIGVhY2ggYXN5bmMgc3RlcCBvZiB0aGUgdXBsb2FkCiAqIHByb2Nlc3MuCiAqIEBwYXJhbSB7c3RyaW5nfSBpbnB1dElkIEVsZW1lbnQgSUQgb2YgdGhlIGlucHV0IGZpbGUgcGlja2VyIGVsZW1lbnQuCiAqIEBwYXJhbSB7c3RyaW5nfSBvdXRwdXRJZCBFbGVtZW50IElEIG9mIHRoZSBvdXRwdXQgZGlzcGxheS4KICogQHJldHVybiB7IUl0ZXJhYmxlPCFPYmplY3Q+fSBJdGVyYWJsZSBvZiBuZXh0IHN0ZXBzLgogKi8KZnVuY3Rpb24qIHVwbG9hZEZpbGVzU3RlcChpbnB1dElkLCBvdXRwdXRJZCkgewogIGNvbnN0IGlucHV0RWxlbWVudCA9IGRvY3VtZW50LmdldEVsZW1lbnRCeUlkKGlucHV0SWQpOwogIGlucHV0RWxlbWVudC5kaXNhYmxlZCA9IGZhbHNlOwoKICBjb25zdCBvdXRwdXRFbGVtZW50ID0gZG9jdW1lbnQuZ2V0RWxlbWVudEJ5SWQob3V0cHV0SWQpOwogIG91dHB1dEVsZW1lbnQuaW5uZXJIVE1MID0gJyc7CgogIGNvbnN0IHBpY2tlZFByb21pc2UgPSBuZXcgUHJvbWlzZSgocmVzb2x2ZSkgPT4gewogICAgaW5wdXRFbGVtZW50LmFkZEV2ZW50TGlzdGVuZXIoJ2NoYW5nZScsIChlKSA9PiB7CiAgICAgIHJlc29sdmUoZS50YXJnZXQuZmlsZXMpOwogICAgfSk7CiAgfSk7CgogIGNvbnN0IGNhbmNlbCA9IGRvY3VtZW50LmNyZWF0ZUVsZW1lbnQoJ2J1dHRvbicpOwogIGlucHV0RWxlbWVudC5wYXJlbnRFbGVtZW50LmFwcGVuZENoaWxkKGNhbmNlbCk7CiAgY2FuY2VsLnRleHRDb250ZW50ID0gJ0NhbmNlbCB1cGxvYWQnOwogIGNvbnN0IGNhbmNlbFByb21pc2UgPSBuZXcgUHJvbWlzZSgocmVzb2x2ZSkgPT4gewogICAgY2FuY2VsLm9uY2xpY2sgPSAoKSA9PiB7CiAgICAgIHJlc29sdmUobnVsbCk7CiAgICB9OwogIH0pOwoKICAvLyBXYWl0IGZvciB0aGUgdXNlciB0byBwaWNrIHRoZSBmaWxlcy4KICBjb25zdCBmaWxlcyA9IHlpZWxkIHsKICAgIHByb21pc2U6IFByb21pc2UucmFjZShbcGlja2VkUHJvbWlzZSwgY2FuY2VsUHJvbWlzZV0pLAogICAgcmVzcG9uc2U6IHsKICAgICAgYWN0aW9uOiAnc3RhcnRpbmcnLAogICAgfQogIH07CgogIGNhbmNlbC5yZW1vdmUoKTsKCiAgLy8gRGlzYWJsZSB0aGUgaW5wdXQgZWxlbWVudCBzaW5jZSBmdXJ0aGVyIHBpY2tzIGFyZSBub3QgYWxsb3dlZC4KICBpbnB1dEVsZW1lbnQuZGlzYWJsZWQgPSB0cnVlOwoKICBpZiAoIWZpbGVzKSB7CiAgICByZXR1cm4gewogICAgICByZXNwb25zZTogewogICAgICAgIGFjdGlvbjogJ2NvbXBsZXRlJywKICAgICAgfQogICAgfTsKICB9CgogIGZvciAoY29uc3QgZmlsZSBvZiBmaWxlcykgewogICAgY29uc3QgbGkgPSBkb2N1bWVudC5jcmVhdGVFbGVtZW50KCdsaScpOwogICAgbGkuYXBwZW5kKHNwYW4oZmlsZS5uYW1lLCB7Zm9udFdlaWdodDogJ2JvbGQnfSkpOwogICAgbGkuYXBwZW5kKHNwYW4oCiAgICAgICAgYCgke2ZpbGUudHlwZSB8fCAnbi9hJ30pIC0gJHtmaWxlLnNpemV9IGJ5dGVzLCBgICsKICAgICAgICBgbGFzdCBtb2RpZmllZDogJHsKICAgICAgICAgICAgZmlsZS5sYXN0TW9kaWZpZWREYXRlID8gZmlsZS5sYXN0TW9kaWZpZWREYXRlLnRvTG9jYWxlRGF0ZVN0cmluZygpIDoKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgJ24vYSd9IC0gYCkpOwogICAgY29uc3QgcGVyY2VudCA9IHNwYW4oJzAlIGRvbmUnKTsKICAgIGxpLmFwcGVuZENoaWxkKHBlcmNlbnQpOwoKICAgIG91dHB1dEVsZW1lbnQuYXBwZW5kQ2hpbGQobGkpOwoKICAgIGNvbnN0IGZpbGVEYXRhUHJvbWlzZSA9IG5ldyBQcm9taXNlKChyZXNvbHZlKSA9PiB7CiAgICAgIGNvbnN0IHJlYWRlciA9IG5ldyBGaWxlUmVhZGVyKCk7CiAgICAgIHJlYWRlci5vbmxvYWQgPSAoZSkgPT4gewogICAgICAgIHJlc29sdmUoZS50YXJnZXQucmVzdWx0KTsKICAgICAgfTsKICAgICAgcmVhZGVyLnJlYWRBc0FycmF5QnVmZmVyKGZpbGUpOwogICAgfSk7CiAgICAvLyBXYWl0IGZvciB0aGUgZGF0YSB0byBiZSByZWFkeS4KICAgIGxldCBmaWxlRGF0YSA9IHlpZWxkIHsKICAgICAgcHJvbWlzZTogZmlsZURhdGFQcm9taXNlLAogICAgICByZXNwb25zZTogewogICAgICAgIGFjdGlvbjogJ2NvbnRpbnVlJywKICAgICAgfQogICAgfTsKCiAgICAvLyBVc2UgYSBjaHVua2VkIHNlbmRpbmcgdG8gYXZvaWQgbWVzc2FnZSBzaXplIGxpbWl0cy4gU2VlIGIvNjIxMTU2NjAuCiAgICBsZXQgcG9zaXRpb24gPSAwOwogICAgZG8gewogICAgICBjb25zdCBsZW5ndGggPSBNYXRoLm1pbihmaWxlRGF0YS5ieXRlTGVuZ3RoIC0gcG9zaXRpb24sIE1BWF9QQVlMT0FEX1NJWkUpOwogICAgICBjb25zdCBjaHVuayA9IG5ldyBVaW50OEFycmF5KGZpbGVEYXRhLCBwb3NpdGlvbiwgbGVuZ3RoKTsKICAgICAgcG9zaXRpb24gKz0gbGVuZ3RoOwoKICAgICAgY29uc3QgYmFzZTY0ID0gYnRvYShTdHJpbmcuZnJvbUNoYXJDb2RlLmFwcGx5KG51bGwsIGNodW5rKSk7CiAgICAgIHlpZWxkIHsKICAgICAgICByZXNwb25zZTogewogICAgICAgICAgYWN0aW9uOiAnYXBwZW5kJywKICAgICAgICAgIGZpbGU6IGZpbGUubmFtZSwKICAgICAgICAgIGRhdGE6IGJhc2U2NCwKICAgICAgICB9LAogICAgICB9OwoKICAgICAgbGV0IHBlcmNlbnREb25lID0gZmlsZURhdGEuYnl0ZUxlbmd0aCA9PT0gMCA/CiAgICAgICAgICAxMDAgOgogICAgICAgICAgTWF0aC5yb3VuZCgocG9zaXRpb24gLyBmaWxlRGF0YS5ieXRlTGVuZ3RoKSAqIDEwMCk7CiAgICAgIHBlcmNlbnQudGV4dENvbnRlbnQgPSBgJHtwZXJjZW50RG9uZX0lIGRvbmVgOwoKICAgIH0gd2hpbGUgKHBvc2l0aW9uIDwgZmlsZURhdGEuYnl0ZUxlbmd0aCk7CiAgfQoKICAvLyBBbGwgZG9uZS4KICB5aWVsZCB7CiAgICByZXNwb25zZTogewogICAgICBhY3Rpb246ICdjb21wbGV0ZScsCiAgICB9CiAgfTsKfQoKc2NvcGUuZ29vZ2xlID0gc2NvcGUuZ29vZ2xlIHx8IHt9OwpzY29wZS5nb29nbGUuY29sYWIgPSBzY29wZS5nb29nbGUuY29sYWIgfHwge307CnNjb3BlLmdvb2dsZS5jb2xhYi5fZmlsZXMgPSB7CiAgX3VwbG9hZEZpbGVzLAogIF91cGxvYWRGaWxlc0NvbnRpbnVlLAp9Owp9KShzZWxmKTsK","ok":true,"headers":[["content-type","application/javascript"]],"status":200,"status_text":""}},"base_uri":"https://localhost:8080/","height":115},"id":"Qek0nAmWe2Jh","executionInfo":{"status":"ok","timestamp":1637834854261,"user_tz":-540,"elapsed":9188,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}},"outputId":"7ca7683e-02c0-4f60-b7c9-d84e5ce60b4c"},"source":["from google.colab import files\n","print('txtファイル(UTF-8）を指定してください')\n","uploaded = files.upload()\n","\n","for fn in uploaded.keys():\n","  print('User uploaded file \"{name}\" with length {length} bytes'.format(name=fn, length=len(uploaded[fn])))"],"execution_count":8,"outputs":[{"output_type":"stream","name":"stdout","text":["txtファイル(UTF-8）を指定してください\n"]},{"output_type":"display_data","data":{"text/html":["\n","     <input type=\"file\" id=\"files-b1d713af-89df-47f9-9c3b-820de9613673\" name=\"files[]\" multiple disabled\n","        style=\"border:none\" />\n","     <output id=\"result-b1d713af-89df-47f9-9c3b-820de9613673\">\n","      Upload widget is only available when the cell has been executed in the\n","      current browser session. Please rerun this cell to enable.\n","      </output>\n","      <script src=\"/nbextensions/google.colab/files.js\"></script> "],"text/plain":["<IPython.core.display.HTML object>"]},"metadata":{}},{"output_type":"stream","name":"stdout","text":["Saving trump.txt to trump.txt\n","User uploaded file \"trump.txt\" with length 30500 bytes\n"]}]},{"cell_type":"code","metadata":{"id":"f5MhajB3hyAg","cellView":"form","executionInfo":{"status":"ok","timestamp":1637834854262,"user_tz":-540,"elapsed":12,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}}},"source":["#@title Similarity_limit setting in pysummarization（Defalt = 0.25） { run: \"auto\" }\n","similarity_limit = 0.25 #@param {type:\"slider\", min:0.05, max:0.5, step:0.05}\n","#similarity_filter.similarity_limit = 0.25"],"execution_count":9,"outputs":[]},{"cell_type":"code","metadata":{"cellView":"form","id":"-Adzv3E0DtAI","executionInfo":{"status":"ok","timestamp":1637836100785,"user_tz":-540,"elapsed":2,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}}},"source":["#@title Specified with ratio setting in bert-extractive-summarizer（Defalt = 0.2） { run: \"auto\" }\n","ratio_set = 0.2 #@param {type:\"slider\", min:0.05, max:0.5, step:0.05}"],"execution_count":21,"outputs":[]},{"cell_type":"markdown","metadata":{"id":"-g3Xq_Q2fSUc"},"source":["# **テキスト要約処理**"]},{"cell_type":"code","metadata":{"id":"F6ILX_Zwe2Dh","executionInfo":{"status":"ok","timestamp":1637834854264,"user_tz":-540,"elapsed":9,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}}},"source":["if len(uploaded.keys()) != 1:\n","    print(\"アップロードは１ファイルにのみ限ります\")\n","else:\n","    target = list(uploaded.keys())[0]\n","    \n","with open(target) as f:\n","    contents = f.readlines()\n","\n","document = ''.join(contents)"],"execution_count":11,"outputs":[]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"WaxUk9W7aecm","executionInfo":{"status":"ok","timestamp":1637834855010,"user_tz":-540,"elapsed":755,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}},"outputId":"1627bbde-89b9-4b41-aee3-8f3e4acf5979"},"source":["print(u'[source]')\n","print(document)\n","\n","# Object of automatic summarization.\n","auto_abstractor = AutoAbstractor()\n","# Set tokenizer.\n","auto_abstractor.tokenizable_doc = SimpleTokenizer()\n","# Set delimiter for making a list of sentence.\n","auto_abstractor.delimiter_list = [\".\", \"\\n\"]\n","# Object of abstracting and filtering document.\n","abstractable_doc = TopNRankAbstractor()\n","# Summarize document.\n","result_dict1 = auto_abstractor.summarize(document, abstractable_doc)\n","\n","# Output result.\n","print(u'[result summary]')\n","for sentence in result_dict1[\"summarize_result\"]:\n","    print(sentence)\n","\n","# NLPオブジェクト\n","nlp_base = NlpBase()\n","# トークナイザー設定\n","nlp_base.tokenizable_doc = SimpleTokenizer()\n","# 類似性フィルター\n","similarity_filter = TfIdfCosine()\n","# NLPオブジェクト設定\n","similarity_filter.nlp_base = nlp_base\n","# 類似性limit：limit超える文は切り捨て\n","similarity_filter.similarity_limit = similarity_limit\n","\n","# Object of automatic summarization.\n","auto_abstractor = AutoAbstractor()\n","# Set tokenizer.\n","auto_abstractor.tokenizable_doc = SimpleTokenizer()\n","# Set delimiter for making a list of sentence.\n","auto_abstractor.delimiter_list = [\".\", \"\\n\"]\n","# Object of abstracting and filtering document.\n","abstractable_doc = TopNRankAbstractor()\n","# Summarize document.\n","result_dict2 = auto_abstractor.summarize(document, abstractable_doc, similarity_filter)\n","\n","# Output result.\n","print(u'[result summary:SL]')\n","for sentence in result_dict2[\"summarize_result\"]:\n","    print(sentence)"],"execution_count":12,"outputs":[{"output_type":"stream","name":"stdout","text":["[source]\n","Friends, delegates and fellow Americans: I humbly and gratefully accept your nomination for the presidency of the United States.\n","\n","Who would have believed that when we started this journey on June 16th of last year, we – and I say we because we are a team – would have received almost 14 million votes, the most in the history of the Republican Party, and that the Republican Party would get 60 percent more votes than it received eight years ago. Who would have believed this? Who would have believed this? The Democrats, on the other hand, received 20 percent fewer votes than they got four years ago. Not so good. Not so good.\n","\n","Together, we will lead our party back to the White House, and we will lead our country back to safety, prosperity, and peace. We will be a country of generosity and warmth. But we will also be a country of law and order.\n","\n","Our Convention occurs at a moment of crisis for our nation. The attacks on our police, and the terrorism in our cities, threaten our very way of life. Any politician who does not grasp this danger is not fit to lead our country.\n","\n","Americans watching this address tonight have seen the recent images of violence in our streets and the chaos in our communities. Many have witnessed this violence personally; some have even been its victims.\n","\n","I have a message for all of you: the crime and violence that today afflicts our nation will soon, and I mean very soon, come to an end. Beginning on January 20th 2017, safety will be restored.\n","\n","The most basic duty of government is to defend the lives of its own citizens. Any government that fails to do so is a government unworthy to lead.\n","\n","It is finally time for a straightforward assessment of the state of our nation.\n","\n","I will present the facts plainly and honestly. We cannot afford to be so politically correct anymore.\n","\n","So if you want to hear the corporate spin, the carefully-crafted lies, and the media myths the Democrats are holding their convention next week. Go there.\n","\n","But here, at our convention, there will be no lies. We will honor the American people with the truth, and nothing else.\n","\n","These are the facts:\n","\n","Decades of progress made in bringing down crime are now being reversed by this Administration’s rollback of criminal enforcement.\n","\n","Homicides last year increased by 17% in America’s fifty largest cities. That’s the largest increase in 25 years. In our nation’s capital, killings have risen by 50 percent. They are up nearly 60% in nearby Baltimore.\n","\n","In the President’s hometown of Chicago, more than 2,000 people have been the victims of shootings this year alone. And almost 4,000 have been killed in the Chicago area since he took office.\n","\n","The number of police officers killed in the line of duty has risen by almost 50% compared to this point last year. Nearly 180,000 illegal immigrants with criminal records, ordered deported from our country, are tonight roaming free to threaten peaceful citizens.\n","\n","The number of new illegal immigrant families who have crossed the border so far this year already exceeds the entire total from 2015. They are being released by the tens of thousands into our communities with no regard for the impact on public safety or resources.\n","\n","One such border-crosser was released and made his way to Nebraska. There, he ended the life of an innocent young girl named Sarah Root. She was 21 years-old, and was killed the day after graduating from college with a 4.0 Grade Point Average, number one in her class. Her killer was then released a second time, and he is now a fugitive from the law.\n","\n","I’ve met Sarah’s beautiful family. But to this Administration, their amazing daughter was just one more American life that wasn’t worth protecting. No more. One more child to sacrifice on the altar of open borders.\n","\n","What about our economy?\n","\n","Again, I will tell you the plain facts that have been edited out of your nightly news and your morning newspaper: Nearly Four in 10 African-American children are living in poverty, while 58% of African-American youth are now not employed. 2 million more Latinos are in poverty today than when President Obama took his oath of office less than eight years ago. Another 14 million people have left the workforce entirely.\n","\n","Household incomes are down more than 4 thousand dollars since the year 2000. That’s 16 years ago. Our trade deficit in goods reached nearly, think of this, think of this, our trade deficit is 800 billion dollars, think of that, 800 billion dollars last year alone. We’re going to fix that.\n","\n","The budget is no better. President Obama has almost doubled our national debt to more than 19 trillion dollars, and growing. And yet, what do we have to show for it? Our roads and bridges are falling apart, our airports are in Third World condition, and forty-three million Americans are on food stamps.\n","\n","Now let us consider the state of affairs abroad.\n","\n","Not only have our citizens endured domestic disaster, but they have lived through one international humiliation after another. One after another. We all remember the images of our sailors being forced to their knees by their Iranian captors at gunpoint.\n","\n","This was just prior to the signing of the Iran deal, which gave back to Iran 150 billion dollars and gave us absolutely nothing – it will go down in history as one of the worst deals ever negotiated. Another humiliation came when president Obama drew a red line in Syria – and the whole world knew it meant absolutely nothing.\n","\n","In Libya, our consulate, the symbol of American prestige around the globe, was brought down in flames. America is far less safe and the world is far less stable than when Obama made the decision to put Hillary Clinton in charge of America’s foreign policy.\n","\n","Let’s defeat her in November.\n","\n","I am certain that it was a decision that President Obama truly regrets. Her bad instincts and her bad judgement, something pointed out by Bernie Sanders, are what caused so many of the disasters unfolding today.\n","\n","Let’s review the record.\n","\n","In 2009, pre-Hillary, ISIS was not even on the map. Libya was stable. Egypt was peaceful. Iraq was seeing really a big, big reduction in violence. Iran was being choked by sanctions. Syria was somewhat under control.\n","\n","After four years of Hillary Clinton, what do we have?\n","\n","ISIS has spread across the region, and the entire world. Libya is in ruins, and our Ambassador and his staff were left helpless to die at the hands of savage killers. Egypt was turned over to the radical Muslim brotherhood, forcing the military to retake control.\n","\n","Iraq is in chaos. Iran is on the path to nuclear weapons. Syria is engulfed in a civil war and a refugee crisis now threatens the West. After fifteen years of wars in the Middle East, after trillions of dollars spent and thousands of lives lost, the situation is worse than it has ever been before.\n","\n","This is the legacy of Hillary Clinton: death, destruction, terrorism and weakness.\n","\n","But Hillary Clinton’s legacy does not have to be America’s legacy. The problems we face now – poverty and violence at home, war and destruction abroad – will last only as long as we continue relying on the same politicians who created them in the first place. A change in leadership is required to produce a change in outcomes.\n","\n","Tonight, I will share with you my plan of action for America.\n","\n","The most important difference between our plan and that of our opponent, is that our plan will put America First. Americanism, not globalism, will be our credo. As long as we are led by politicians who will not put America First, then we can be assured that other nations will not treat America with respect, the respect that we deserve.\n","\n","The American People will come first once again. My plan will begin with safety at home – which means safe neighborhoods, secure borders, and protection from terrorism. There can be no prosperity without law and order.\n","\n","On the economy, I will outline reforms to add millions of new jobs and trillions in new wealth that can be used to rebuild America.\n","\n","A number of these reforms that I will outline tonight will be opposed by some of our nation’s most powerful special interests. That is because these interests have rigged our political and economic system for their exclusive benefit. Believe me. It’s for their benefit.\n","\n","Big business, elite media and major donors are lining up behind the campaign of my opponent because they know she will keep our rigged system in place. They are throwing money at her because they have total control over every single thing she does. She is their puppet, and they pull the strings.\n","\n","That is why Hillary Clinton’s message is that things will never change – never ever. My message is that things have to change – and they have to change right now. Every day I wake up determined to deliver a better life for the people all across this nation that have been ignored, neglected and abandoned.\n","\n","I have visited the laid-off factory workers, and the communities crushed by our horrible and unfair trade deals. These are the forgotten men and women of our country, and they are forgotten, but they are not going to be forgotten long. These are people who work hard but no longer have a voice.\n","\n","I AM YOUR VOICE.\n","\n","I have embraced crying mothers who have lost their children because our politicians put their personal agendas before the national good. I have no patience for injustice, no tolerance for government incompetence, no sympathy for leaders who fail their citizens.\n","\n","When innocent people suffer, because our political system lacks the will, or the courage, or the basic decency to enforce our laws – or still worse, has sold out to some corporate lobbyist for cash – I am not able to look the other way. And I won’t look the other way.\n","\n","And when a Secretary of State illegally stores her emails on a private server, deletes 33,000 of them so the authorities can’t see her crime, puts our country at risk, lies about it in every different form and faces no consequence – I know that corruption has reached a level like never ever before in our country.\n","\n","When the FBI Director says that the Secretary of State was “extremely careless” and “negligent,” in handling our classified secrets, I also know that these terms are minor compared to what she actually did. They were just used to save her from facing justice for her terrible, terrible crimes.\n","\n","In fact, her single greatest accomplishment may be committing such an egregious crime and getting away with it – especially when others, who have done far less, have paid so dearly. When that same Secretary of State rakes in millions and millions of dollars trading access and favors to special interests and foreign powers I know the time for action has come.\n","\n","I have joined the political arena so that the powerful can no longer beat up on people who cannot defend themselves. Nobody knows the system better than me, which is why I alone can fix it. I have seen firsthand how the system is rigged against our citizens, just like it was rigged against Bernie Sanders – he never had a chance. Never had a chance.\n","\n","But his supporters will join our movement, because we will fix his biggest single issue: trade deals that strip our country of its jobs and strip us of our wealth as a country. Millions of Democrats will join our movement because we are going to fix the system so it works fairly, and justly, for each and every American.\n","\n","In this cause, I am proud to have at my side the next Vice President of the United States: Governor Mike Pence of Indiana.We will bring the same economic success to America that Mike brought to Indiana which is amazing. He is a man of character and accomplishment. He is the man for the job.The first task for our new Administration will be to liberate our citizens from the crime and terrorism and lawlessness that threatens our communities.\n","\n","America was shocked to its core when our police officers in Dallas were so brutally executed. Immediately after Dallas, we have seen continued threats and violence against our law enforcement officials. Law officers have been shot or killed in recent days in Georgia, Missouri, Wisconsin, Kansas, Michigan and Tennessee.\n","\n","On Sunday, more police were gunned down in Baton Rouge, Louisiana. Three were killed, and three were very, very badly injured.　An attack on law enforcement is an attack on all Americans. I have a message to every last person threatening the peace on our streets and the safety of our police: when I take the oath of office next year, I will restore law and order to our country. Believe me. Believe me.\n","\n","I will work with, and appoint, the best and brightest prosecutors and law enforcement officials to get the job properly done. In this race for the White House, I am the Law And Order candidate. The irresponsible rhetoric of our President, who has used the pulpit of the presidency to divide us by race and color, has made America a more dangerous environment than frankly, I have ever seen and anybody in this room has ever watched or seen.\n","\n","This Administration has failed America’s inner cities. Remember. It has failed America’s inner cities. It’s failed them on education. It’s failed them on jobs. It’s failed them on crime. It’s failed them in every way and on every single level.\n","\n","When I am President, I will work to ensure that all of our kids are treated equally, and protected equally.\n","\n","Every action I take, I will ask myself: does this make better for young Americans in Baltimore, in Chicago, in Detroit, in Ferguson who have really in every way, folks, the same right to live out their dreams as any other child in America? Any other child...\n","\n","To make life safe for all our citizens, we must also address the growing threats we face from outside the country: we are going to defeat the barbarians of ISIS and we’re going to defeat them fast. Once again, France is the victim of brutal Islamic terrorism.\n","\n","Men, women and children viciously mowed down. Lives ruined. Families ripped apart. A nation in mourning.\n","\n","The damage and devastation that can be inflicted by Islamic radicals has been proven over and over – at the World Trade Center, at an office party in San Bernardino, at the Boston Marathon, at a military recruiting center in Chattanooga, and many many other locations.\n","\n","Only weeks ago, in Orlando, Florida, 49 wonderful Americans were savagely murdered by an Islamic terrorist. This time, the terrorist targeted LGBTQ community.\n","\n","No good. We are going to stop it.\n","\n","As your President, I will do everything in my power to protect our LGBTQ citizens from the violence and oppression of a hateful foreign ideology. Believe me.　I have to say as a republican it is so nice to hear your cheering about what I just said. Thank you. To protect us from terrorism, we need to focus on three things.\n","\n","We must have the best, absolutely the best gathering of intelligence anywhere in the world. The best. We must abandon the failed policy of nation-building and regime change that Hillary Clinton pushed in Iraq, in Libya, in Egypt and in Syria.\n","\n","Instead, we must work with all of our allies who share our goal of destroying ISIS and stamping out Islamic terrorism and doing it now and doing it quickly. We’re going to win and we’re going to win fast. This includes working with our greatest ally in the region, the State of Israel.\n","\n","Recently, I have said that NATO was obsolete, because it did not properly cover terror, and also, that many of the member countries were not paying their fair share. As usual, the United States has been picking up the cost.　Shortly thereafter, it was announced that NATO will be setting up a new program in order to combat terrorism -- a true step in the right direction.\n","\n","Lastly, and very importantly, we must immediately suspend immigration from any nation that has been compromised by terrorism until such time as proven vetting mechanisms have been put in place. We don’t want them in our country.\n","\n","My opponent has called for a radical 550% increase in Syrian, think of this, think of　this,　this is not believable but this is what’s happening, a 550% increase in Syrian refugees on top of the existing massive refugee flows coming into our country already under the leadership of President Obama. She proposes this despite the fact that there’s no way to screen these refugees in order to find out who they are or where they come from. I only want to admit individuals into our country who will support our values and love our people.\n","\n","Anyone who endorses violence, hatred or oppression is not welcome in our country　and never ever will be.\n","\n","Decades of record immigration have produced lower wages and higher unemployment for our citizens, especially for African-American and Latino workers. We are going to have an immigration system that works, but one that works for the American people. On Monday, we heard from three parents whose children were killed by illegal immigrants—Mary Ann Mendoza, Sabine Durden, and my friend Jamiel Shaw. They are just three brave representatives of many thousands who have suffered so gravely.\n","\n","Of all my travels in this country, nothing has affected me more, nothing even close I have to tell you, than the time I have spent with the mothers and fathers who have lost their children to violence spilling across our borders, which we can solve, we have to solve them.\n","\n","These families have no special interests to represent them. There are no demonstrators to protect them, and certainly none to protest on their behalf. My opponent will never meet with them, or share in their pain. Believe me. Instead, my opponent wants Sanctuary Cities.\n","\n","But where was the sanctuary for Kate Steinle? Where was the Sanctuary for the children of Mary Ann, and Sabine, and Jamiel? Where was the Sanctuary for all the other Americans who have been so brutally murdered, and who have suffered so so horribly?\n","\n","These wounded American families have been alone. But they are not alone any longer. Tonight, this candidate and the whole nation stand in their corner to support them, to send them our love, and to pledge in their honor that we will save countless more families from suffering and the same awful fate.\n","\n","We are going to build a great border wall to stop illegal immigration, to stop the gangs and the violence, and to stop the drugs from pouring into our communities. I have been honored to receive the endorsement of America’s Border Patrol Agents, and will work directly with them to protect the integrity of our lawful, lawful, lawful immigration system.\n","\n","By ending catch-and-release on the border, we will end the cycle of human smuggling and violence. Illegal border crossings will go down. We will stop it, it won’t be happening very much any more. Believe me. Peace will be restored. By enforcing the rules for millions who overstay their visas, our laws will finally receive the respect that they deserve.\n","\n","Tonight, I want every American whose demands for immigration security have been denied – and every politician who has denied them – to listen very, very closely to the words I am about to say.\n","\n","On January 20th of 2017, the day I take the oath of office, Americans will finally wake up in a country where the laws of the United States are enforced. We are going to be considerate and compassionate to everyone.\n","\n","But my greatest compassion will be for our own struggling citizens. My plan is the exact opposite of the radical and dangerous immigration policy of Hillary Clinton. Americans want relief from uncontrolled immigration which is what we have now. Communities want relief.\n","\n","Yet Hillary Clinton is proposing mass amnesty, mass immigration, and mass lawlessness. Her plan will overwhelm your schools and hospitals, further reduce your jobs and wages, and make it harder for recent immigrants to escape the tremendous cycle of poverty that they are going through right now and make it almost impossible for them to join the middle class.\n","\n","I have a different vision for our workers. It begins with a new, fair trade policy that protects our jobs and stands up to countries that cheat of which there many. It’s been a signature message of my campaign from day one, and it will be a signature feature of my presidency from the moment I take the oath of office.\n","\n","I have made billions of dollars in business making deals – now I’m going to make our country rich again. Using the greatest business people in the world which our country has, I am going to turn our bad trade agreements into great trade agreements. America has lost nearly one-third of its manufacturing jobs since 1997, following the enactment of disastrous trade deals supported by Bill and Hillary Clinton.\n","\n","Remember, it was Bill Clinton who signed NAFTA, one of the worst economic deals ever made by our country or frankly, any other country.\n","\n","Never ever again.\n","\n","I am going to bring back our jobs to Ohio, and Pennsylvania, and New York, and Michigan and to all of America – and I am not going to let companies move to other countries, firing their employees along the way, without consequence. Not going to happen any more.\n","\n","My opponent, on the other hand, has supported virtually every trade agreement that has been destroying our middle class. She supported NAFTA, and she supported China’s entrance into the World Trade Organization – another one of her husband’s colossal mistakes and disasters.\n","\n","She supported the job-killing trade deal with South Korea. She has supported the Trans-Pacific Partnership – which will not only destroy our manufacturing, but it will make America subject to the rulings of foreign governments. And it’s not going to happen. I pledge to never sign any trade agreement that hurts our workers, or that diminishes our freedom and our independence. We will never ever sign bad trade deals. America first again. America first.　Instead, I will make individual deals with individual countries.\n","\n","No longer will we enter into these massive transactions, with many countries, that are thousands of pages long – and which no one from our country even reads or understands.　We are going to enforce all trade violations against any country that cheats.\n","\n","This includes stopping China’s outrageous theft of intellectual property, along with their illegal product dumping, and their devastating currency manipulation. They are the greatest that ever came about. They are the greatest currency manipulators ever.　Our horrible trade agreements with China, and many others, will be totally renegotiated. That includes renegotiating NAFTA to get a much better deal for America – and we’ll walk away if we don’t get that kind of deal. Our country is going to start building and making things again.\n","\n","Next comes the reform of our tax laws, regulations and energy rules. While Hillary Clinton plans a massive, and I mean massive tax increase, I have proposed the largest tax reduction of any candidate who has run for president this year – Democrat or Republican. Middle-income Americans and businesses will experience profound relief, and taxes will be greatly simplified for everyone. I mean everyone.\n","\n","America is one of the highest-taxed nations in the world. Reducing taxes will cause new companies and new jobs to come roaring back into our country. Believe me. It will happen and it will happen fast. Then we are going to deal with the issue of regulation, one of the greatest job-killers of them all. Excessive regulation is costing our country as much as 2 trillion dollars a year, and we will end it very, very quickly.\n","\n","We are going to lift the restrictions on the production of American energy. This will produce more than 20 trillion dollars in job-creating economic activity over the next four decades.\n","\n","My opponent, on the other hand, wants to put the great miners and the great steel workers of our country out of work and out of business. That will never happen when Donald J Trump is President. Our steel workers and our miners are going back to work again. With these new economic policies, trillions of trillions of dollars will start flowing into our country.\n","\n","This new wealth will improve the quality of life for all Americans. We will build the roads, highways, bridges, tunnels, airports, and the railways of tomorrow. This, in turn, will create millions of more jobs. We will rescue kids from failing schools by helping their parents send them to a safe school of their choice.\n","\n","My opponent would rather protect bureaucrats than serve American children. And that’s what she’s doing and that’s what she’s done. We will repeal and replace disastrous Obamacare. You will be able to choose your own doctor again. And we will fix TSA at the airports which is a total disaster.\n","\n","We going to work with all of our students who are drowning in debt to take the pressure off these young people just starting out their adult lives. Tremendous problem. We will completely rebuild our depleted military, and the countries that we are protecting, at a massive cost to us, will be asked to pay their fair share.\n","\n","We will take care of our great Veterans like they have never been taken care of before. My just-released Ten Point Plan has received tremendous veteran support. We will guarantee those who serve this country will be able to visit the doctor or hospital of their choice without waiting five days on a line and dying.\n","\n","My opponent dismissed the VA scandal – one more sign of how out of touch she really is. We are going to ask every Department Head in government to provide a list of wasteful spending on projects that we can eliminate in my first 100 days. The politicians have talked about this for years, but I’m going to do it. We are going to appoint justices to the United States Supreme Court who will uphold our laws and our Constitution.\n","\n","The replacement of our beloved Justice Scalia will be a person of similar views, principles, and judicial philosophies. Very important. This will be one of the most important issues decided by this election. My opponent wants to essentially abolish the 2nd amendment. I, on the other hand, received the early and strong endorsement of the National Rifle Association and will protect the right of all Americans to keep their families safe.\n","\n","At this moment, I would like to thank the evangelical and religious community because, I tell you what, the support they have given me — and I'm not sure I totally deserve it — has been so amazing. And has been such a big reason for me being here tonight. True. So true. They have much to contribute to our politics, yet our laws prevent you from speaking your minds from your own pulpits.\n","\n","An amendment, pushed by Lyndon Johnson, many years ago, threatens religious institutions with a loss of their tax-exempt status if they openly advocate their political views. Their voice is taken away.I am going to work very hard to repeal that language and to protect free speech for all Americans.\n","\n","We can accomplish these great things, and so much more – all we need to do is start believing in ourselves and in our country again. Start believing. It is time to show the whole world that America Is Back – bigger, and better and stronger than ever before.\n","\n","In this journey, I'm so lucky to have at my side my wife Melania and my wonderful children, Don, Ivanka, Eric, Tiffany, and Barron: you will always be my greatest source of pride and joy. And by the way, Melania and Ivanka, did they do a job? My Dad, Fred Trump, was the smartest and hardest working man I ever knew. I wonder sometimes what he’d say if he were here to see this and to see me tonight.\n","\n","It’s because of him that I learned, from my youngest age, to respect the dignity of work and the dignity of working people. He was a guy most comfortable in the company of bricklayers, and carpenters, and electricians and I have a lot of that in me also. I love those people.\n","\n","Then there’s my mother, Mary. She was strong, but also warm and fairminded. She was a truly great mother. She was also one of the most honest and charitable people that I have ever known, and a great, great judge of character. She could pick them out from anywhere.\n","\n","To my sisters Mary Anne and Elizabeth, my brother Robert and my late brother Fred, I will always give you my love—you are most special to me. I have had a truly great life in business.\n","\n","But now, my sole and exclusive mission is to go to work for our country – to go to work for you. It’s time to deliver a victory for the American people. We don’t win any more, but we are going to start winning again.\n","\n","But to do that, we must break free from the petty politics of the past. America is a nation of believers, dreamers, and strivers that is being led by a group of censors, critics and cynics.\n","\n","Remember: all of the people telling you that you can’t have the country you want, are the same people that wouldn’t stand, I mean they said Trump does not have a chance of being here tonight, not a chance, the same people. We love defeating those people, don't we? Love it.\n","\n","No longer can we rely on those same people in the media, and politics, who will say anything to keep our rigged system in place. Instead, we must choose to believe In America. History is watching us now. We don’t have much time, but history is watching.\n","\n","It’s waiting to see if we will rise to the occasion, and if we will show the whole world that America is still free and independent and strong. I'm asking for your support tonight so that I can be your champion in the White House. And I will be your champion.\n","\n","My opponent asks her supporters to recite a three-word loyalty pledge. It reads: “I’m With Her”. I choose to recite a different pledge.\n","\n","My pledge reads: “I’M WITH YOU – THE AMERICAN PEOPLE.”\n","\n","I am your voice.\n","\n","So to every parent who dreams for their child, and every child who dreams for their future, I say these words to you tonight: I am with you, I will fight for you, and I will win for you.\n","\n","To all Americans tonight, in all of our cities and in all of our towns, I make this promise: We Will Make America Strong Again.\n","\n","We Will Make America Proud Again.\n","\n","We Will Make America Safe Again.\n","\n","And We Will Make America Great Again.\n","\n","God bless You And Good Night.　I love you.\n","[result summary]\n","Friends, delegates and fellow Americans: I humbly and gratefully accept your nomination for the presidency of the United States.\n","\n","Who would have believed that when we started this journey on June 16th of last year, we – and I say we because we are a team – would have received almost 14 million votes, the most in the history of the Republican Party, and that the Republican Party would get 60 percent more votes than it received eight years ago.\n","\n"," Who would have believed this? Who would have believed this? The Democrats, on the other hand, received 20 percent fewer votes than they got four years ago.\n","\n","Together, we will lead our party back to the White House, and we will lead our country back to safety, prosperity, and peace.\n","\n"," We will be a country of generosity and warmth.\n","\n"," But we will also be a country of law and order.\n","\n","Our Convention occurs at a moment of crisis for our nation.\n","\n"," Millions of Democrats will join our movement because we are going to fix the system so it works fairly, and justly, for each and every American.\n","\n"," We will completely rebuild our depleted military, and the countries that we are protecting, at a massive cost to us, will be asked to pay their fair share.\n","\n"," I'm asking for your support tonight so that I can be your champion in the White House.\n","\n"]},{"output_type":"stream","name":"stderr","text":["/usr/local/lib/python3.7/dist-packages/pysummarization/similarityfilter/tfidf_cosine.py:46: RuntimeWarning: invalid value encountered in double_scalars\n","  result = dot_prod / (norm_x * norm_y)\n"]},{"output_type":"stream","name":"stdout","text":["[result summary:SL]\n","Friends, delegates and fellow Americans: I humbly and gratefully accept your nomination for the presidency of the United States.\n","\n","Who would have believed that when we started this journey on June 16th of last year, we – and I say we because we are a team – would have received almost 14 million votes, the most in the history of the Republican Party, and that the Republican Party would get 60 percent more votes than it received eight years ago.\n","\n"," We will be a country of generosity and warmth.\n","\n"," But we will also be a country of law and order.\n","\n","I have a message for all of you: the crime and violence that today afflicts our nation will soon, and I mean very soon, come to an end.\n","\n","Again, I will tell you the plain facts that have been edited out of your nightly news and your morning newspaper: Nearly Four in 10 African-American children are living in poverty, while 58% of African-American youth are now not employed.\n","\n","This was just prior to the signing of the Iran deal, which gave back to Iran 150 billion dollars and gave us absolutely nothing – it will go down in history as one of the worst deals ever negotiated.\n","\n","On the economy, I will outline reforms to add millions of new jobs and trillions in new wealth that can be used to rebuild America.\n","\n"," We will completely rebuild our depleted military, and the countries that we are protecting, at a massive cost to us, will be asked to pay their fair share.\n","\n","We can accomplish these great things, and so much more – all we need to do is start believing in ourselves and in our country again.\n","\n"]}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":270,"referenced_widgets":["b5fe7dd130a64dfba01b251929442306","f730b56590b04e9b8b7b22a1fccca273","adcd084a85a04937853a12295d7db3db","4693d9e0a1614187a0eae83b52fb25a2","3aeabaa99c1b47898567d9054c9a8029","a11d28d5bf8740559d99076ecb0abb14","712144f350704cfea255c58f95169d35","416d89df7d1a459e90578c5c4393134a","86e8ee19db5b46f9a9f8516818328885","da302d31b0524483bc08525f9f35ff2e","c94f3f83563e4c05bf90f5aeda92360c","0fab533089844864b5c2b08c5aa18ce8","512d4625dc024b14a28ad6c69fa88a66","b480db4dd91a476299d79d42b780bc5a","2fd2d51cb5764613880193df6686cd66","1bf5cba23dae4b039a3dbf907e6e3056","4897a3999f44434488a6447f858c7fcd","78aaac6af1ab42c4bf309d06c141183e","45bc8d030536455db7d1aed770c583d2","4304fee4069540dba5ef7acea1564be9","cb31042aa92e4730a0841e2324a0168e","7ae7ed1457344ec8b01f0535080d4b21","c82597bc882e4437bff3f052c8725879","824a63c78f9c4522a2bec5f0e0a860b4","25029363a6234281b689193ebab05a4e","0584928e947f49d69b9e6b1a7358d83f","8c51eff9dd874eb7b9804fe747c6f422","2357efd8d0394ba9b6df5955dd4ea541","4fadd7bf60a3404eb8395dea8c4fd447","0db4926964004c9a92b0e43ce0bd2b76","6ed072b5c65c464dbaa583cc686a8501","d03d8f440aef44da8725779f60d5221d","a720f72d1da44827adb087497a6fd2ff","fb4e8ce5b705459282f98647715c1b7e","a3dcac96d8c24241b4647d4353493740","51c8d7bad9ec49448bd9d08c585cf310","e1e5a835aeab497289f58875d11ae353","7b77cff2324e4d58aa128167fdc7f316","d475170006db47cabdb3a7d6dffbaba9","97c127a4ba2545e4879d6f0f3f3bc4e6","4e0921210d17469a9162b7d8e4f0fd6a","c691c73f6ac1447a935abd794d339731","93773d09915b43deb352f4fd79152a52","fc07f36dc1e64f1c97b7bdbc556a5dc6","298b9025f16a4b14b2df92961a51bf07","72c5e7fdbeca4ad5b5bfc4fec12faacf","f99261ce6792459da3ed20c2d7e66c70","e100fb02397a409692b4f8184b0a42bd","a0f958fc24fe4cd5892b7dc0e970cac6","241bbd40ddf343c5b1a292cf2cd580fe","280488fafa0b427cb592a76192c76efc","3bf3a5cf9aae4a3aab28bac00291ce79","54ec5c95dbf64fbcb5eb48d288c22f4c","ecb02b16d60d4095a7b54b3aeafb74c5","e9b00640a2f74dc3bbd3e87ba21e66a3"]},"id":"VJq1uACS_CwK","executionInfo":{"status":"ok","timestamp":1637835022693,"user_tz":-540,"elapsed":167689,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}},"outputId":"8c9a0b1f-e9f3-4792-f3f8-8418b300ed60"},"source":["# bert-extractive-summarizer\n","from summarizer import Summarizer\n","\n","model = Summarizer()\n","result = model(document, ratio=ratio_set)  # Specified with ratio\n","#result = model(document, num_sentences=10)  # Will return 3 sentences \n","#result = model(document, min_length=60)\n","full = ''.join(result)\n","print(full)"],"execution_count":13,"outputs":[{"output_type":"display_data","data":{"application/vnd.jupyter.widget-view+json":{"model_id":"b5fe7dd130a64dfba01b251929442306","version_minor":0,"version_major":2},"text/plain":["Downloading:   0%|          | 0.00/571 [00:00<?, ?B/s]"]},"metadata":{}},{"output_type":"display_data","data":{"application/vnd.jupyter.widget-view+json":{"model_id":"0fab533089844864b5c2b08c5aa18ce8","version_minor":0,"version_major":2},"text/plain":["Downloading:   0%|          | 0.00/1.25G [00:00<?, ?B/s]"]},"metadata":{}},{"output_type":"stream","name":"stderr","text":["Some weights of the model checkpoint at bert-large-uncased were not used when initializing BertModel: ['cls.predictions.transform.dense.weight', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.decoder.weight', 'cls.predictions.transform.dense.bias', 'cls.seq_relationship.bias', 'cls.predictions.bias', 'cls.seq_relationship.weight', 'cls.predictions.transform.LayerNorm.weight']\n","- This IS expected if you are initializing BertModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).\n","- This IS NOT expected if you are initializing BertModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).\n"]},{"output_type":"display_data","data":{"application/vnd.jupyter.widget-view+json":{"model_id":"c82597bc882e4437bff3f052c8725879","version_minor":0,"version_major":2},"text/plain":["Downloading:   0%|          | 0.00/226k [00:00<?, ?B/s]"]},"metadata":{}},{"output_type":"display_data","data":{"application/vnd.jupyter.widget-view+json":{"model_id":"fb4e8ce5b705459282f98647715c1b7e","version_minor":0,"version_major":2},"text/plain":["Downloading:   0%|          | 0.00/28.0 [00:00<?, ?B/s]"]},"metadata":{}},{"output_type":"display_data","data":{"application/vnd.jupyter.widget-view+json":{"model_id":"298b9025f16a4b14b2df92961a51bf07","version_minor":0,"version_major":2},"text/plain":["Downloading:   0%|          | 0.00/455k [00:00<?, ?B/s]"]},"metadata":{}},{"output_type":"stream","name":"stdout","text":["Friends, delegates and fellow Americans: I humbly and gratefully accept your nomination for the presidency of the United States. Who would have believed that when we started this journey on June 16th of last year, we – and I say we because we are a team – would have received almost 14 million votes, the most in the history of the Republican Party, and that the Republican Party would get 60 percent more votes than it received eight years ago. We will be a country of generosity and warmth. But we will also be a country of law and order. So if you want to hear the corporate spin, the carefully-crafted lies, and the media myths the Democrats are holding their convention next week. And almost 4,000 have been killed in the Chicago area since he took office. They are being released by the tens of thousands into our communities with no regard for the impact on public safety or resources. Again, I will tell you the plain facts that have been edited out of your nightly news and your morning newspaper: Nearly Four in 10 African-American children are living in poverty, while 58% of African-American youth are now not employed. ISIS has spread across the region, and the entire world. A change in leadership is required to produce a change in outcomes. As long as we are led by politicians who will not put America First, then we can be assured that other nations will not treat America with respect, the respect that we deserve. That is because these interests have rigged our political and economic system for their exclusive benefit. She is their puppet, and they pull the strings. When innocent people suffer, because our political system lacks the will, or the courage, or the basic decency to enforce our laws – or still worse, has sold out to some corporate lobbyist for cash – I am not able to look the other way. Millions of Democrats will join our movement because we are going to fix the system so it works fairly, and justly, for each and every American. Shortly thereafter, it was announced that NATO will be setting up a new program in order to combat terrorism -- a true step in the right direction. There are no demonstrators to protect them, and certainly none to protest on their behalf. On January 20th of 2017, the day I take the oath of office, Americans will finally wake up in a country where the laws of the United States are enforced. Reducing taxes will cause new companies and new jobs to come roaring back into our country. You will be able to choose your own doctor again. We will take care of our great Veterans like they have never been taken care of before. We are going to ask every Department Head in government to provide a list of wasteful spending on projects that we can eliminate in my first 100 days. We can accomplish these great things, and so much more – all we need to do is start believing in ourselves and in our country again. To my sisters Mary Anne and Elizabeth, my brother Robert and my late brother Fred, I will always give you my love—you are most special to me. We don’t win any more, but we are going to start winning again. We don’t have much time, but history is watching.\n"]}]},{"cell_type":"code","metadata":{"id":"d5Ap1TjUya3P","executionInfo":{"status":"ok","timestamp":1637835022694,"user_tz":-540,"elapsed":14,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}}},"source":["doc0 = ''.join(s for s in document)\n","doc1 = result_dict1[\"summarize_result\"]\n","doc2 = result_dict2[\"summarize_result\"]\n","doc1 = ''.join(s for s in doc1)\n","doc2 = ''.join(s for s in doc2)\n","doc3 = ''.join(s for s in full)\n","lst1 = [\"source\",\"result summary\",\"result summary:SL\",\"bert_extra_summary\"]\n","lst2 = [doc0,doc1,doc2,doc3]\n","df = pd.DataFrame(list(zip(lst1,lst2)), columns = ['Class.','Content'])\n","df = df.replace( '\\n', '', regex=True)"],"execution_count":14,"outputs":[]},{"cell_type":"code","metadata":{"id":"sldyEr9Kl_ZP","executionInfo":{"status":"ok","timestamp":1637835022695,"user_tz":-540,"elapsed":12,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}}},"source":["with pd.option_context('display.max_rows', None, 'display.max_columns', None, 'display.colheader_justify','light', 'display.width', 2000, 'display.max_colwidth', 500):\n","    df = df.stack().str.lstrip().unstack()\n","    df = df.style.set_properties(**{'text-align': 'left'})"],"execution_count":15,"outputs":[]},{"cell_type":"code","metadata":{"id":"ZfyJWj-ZoZNK","executionInfo":{"status":"ok","timestamp":1637835022695,"user_tz":-540,"elapsed":11,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}}},"source":["#要約結果出力（txt & docx)\n","result = '[result_summary]' +'\\n'+ doc1 +'\\n'+ '[result_summary:similarity_limit]' +'\\n'+ doc2 + '[result_summary:bert_extra]' +'\\n'+ doc3\n","with open(\"result_summary.txt\", \"w\") as text_file:\n","    text_file.write(\"String Variable: %s\" % result)\n","\n","docx = Document() \n","docx.add_paragraph(result)\n","docx.save('result_summary.docx')"],"execution_count":16,"outputs":[]},{"cell_type":"markdown","metadata":{"id":"HIE2y21Dfizq"},"source":["# **テキスト要約結果**"]},{"cell_type":"code","metadata":{"id":"6CFpbMQOjidn","colab":{"base_uri":"https://localhost:8080/","height":1000},"executionInfo":{"status":"ok","timestamp":1637835022696,"user_tz":-540,"elapsed":12,"user":{"displayName":"Atsu Mae","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GhkBdV22riCQymGLHfpx2ENIseSoI8q6luTr2H-tg=s64","userId":"10059848880947889702"}},"outputId":"dab63d58-b59d-4c15-d322-2f714d42c5d4"},"source":["df"],"execution_count":17,"outputs":[{"output_type":"execute_result","data":{"text/html":["<style  type=\"text/css\" >\n","#T_e6945576_4dd7_11ec_9b15_0242ac1c0002row0_col0,#T_e6945576_4dd7_11ec_9b15_0242ac1c0002row0_col1,#T_e6945576_4dd7_11ec_9b15_0242ac1c0002row1_col0,#T_e6945576_4dd7_11ec_9b15_0242ac1c0002row1_col1,#T_e6945576_4dd7_11ec_9b15_0242ac1c0002row2_col0,#T_e6945576_4dd7_11ec_9b15_0242ac1c0002row2_col1,#T_e6945576_4dd7_11ec_9b15_0242ac1c0002row3_col0,#T_e6945576_4dd7_11ec_9b15_0242ac1c0002row3_col1{\n","            text-align:  left;\n","        }</style><table id=\"T_e6945576_4dd7_11ec_9b15_0242ac1c0002\" class=\"dataframe\"><thead>    <tr>        <th class=\"blank level0\" ></th>        <th class=\"col_heading level0 col0\" >Class.</th>        <th class=\"col_heading level0 col1\" >Content</th>    </tr></thead><tbody>\n","                <tr>\n","                        <th id=\"T_e6945576_4dd7_11ec_9b15_0242ac1c0002level0_row0\" class=\"row_heading level0 row0\" >0</th>\n","                        <td id=\"T_e6945576_4dd7_11ec_9b15_0242ac1c0002row0_col0\" class=\"data row0 col0\" >source</td>\n","                        <td id=\"T_e6945576_4dd7_11ec_9b15_0242ac1c0002row0_col1\" class=\"data row0 col1\" >Friends, delegates and fellow Americans: I humbly and gratefully accept your nomination for the presidency of the United States.Who would have believed that when we started this journey on June 16th of last year, we – and I say we because we are a team – would have received almost 14 million votes, the most in the history of the Republican Party, and that the Republican Party would get 60 percent more votes than it received eight years ago. Who would have believed this? Who would have believed this? The Democrats, on the other hand, received 20 percent fewer votes than they got four years ago. Not so good. Not so good.Together, we will lead our party back to the White House, and we will lead our country back to safety, prosperity, and peace. We will be a country of generosity and warmth. But we will also be a country of law and order.Our Convention occurs at a moment of crisis for our nation. The attacks on our police, and the terrorism in our cities, threaten our very way of life. Any politician who does not grasp this danger is not fit to lead our country.Americans watching this address tonight have seen the recent images of violence in our streets and the chaos in our communities. Many have witnessed this violence personally; some have even been its victims.I have a message for all of you: the crime and violence that today afflicts our nation will soon, and I mean very soon, come to an end. Beginning on January 20th 2017, safety will be restored.The most basic duty of government is to defend the lives of its own citizens. Any government that fails to do so is a government unworthy to lead.It is finally time for a straightforward assessment of the state of our nation.I will present the facts plainly and honestly. We cannot afford to be so politically correct anymore.So if you want to hear the corporate spin, the carefully-crafted lies, and the media myths the Democrats are holding their convention next week. Go there.But here, at our convention, there will be no lies. We will honor the American people with the truth, and nothing else.These are the facts:Decades of progress made in bringing down crime are now being reversed by this Administration’s rollback of criminal enforcement.Homicides last year increased by 17% in America’s fifty largest cities. That’s the largest increase in 25 years. In our nation’s capital, killings have risen by 50 percent. They are up nearly 60% in nearby Baltimore.In the President’s hometown of Chicago, more than 2,000 people have been the victims of shootings this year alone. And almost 4,000 have been killed in the Chicago area since he took office.The number of police officers killed in the line of duty has risen by almost 50% compared to this point last year. Nearly 180,000 illegal immigrants with criminal records, ordered deported from our country, are tonight roaming free to threaten peaceful citizens.The number of new illegal immigrant families who have crossed the border so far this year already exceeds the entire total from 2015. They are being released by the tens of thousands into our communities with no regard for the impact on public safety or resources.One such border-crosser was released and made his way to Nebraska. There, he ended the life of an innocent young girl named Sarah Root. She was 21 years-old, and was killed the day after graduating from college with a 4.0 Grade Point Average, number one in her class. Her killer was then released a second time, and he is now a fugitive from the law.I’ve met Sarah’s beautiful family. But to this Administration, their amazing daughter was just one more American life that wasn’t worth protecting. No more. One more child to sacrifice on the altar of open borders.What about our economy?Again, I will tell you the plain facts that have been edited out of your nightly news and your morning newspaper: Nearly Four in 10 African-American children are living in poverty, while 58% of African-American youth are now not employed. 2 million more Latinos are in poverty today than when President Obama took his oath of office less than eight years ago. Another 14 million people have left the workforce entirely.Household incomes are down more than 4 thousand dollars since the year 2000. That’s 16 years ago. Our trade deficit in goods reached nearly, think of this, think of this, our trade deficit is 800 billion dollars, think of that, 800 billion dollars last year alone. We’re going to fix that.The budget is no better. President Obama has almost doubled our national debt to more than 19 trillion dollars, and growing. And yet, what do we have to show for it? Our roads and bridges are falling apart, our airports are in Third World condition, and forty-three million Americans are on food stamps.Now let us consider the state of affairs abroad.Not only have our citizens endured domestic disaster, but they have lived through one international humiliation after another. One after another. We all remember the images of our sailors being forced to their knees by their Iranian captors at gunpoint.This was just prior to the signing of the Iran deal, which gave back to Iran 150 billion dollars and gave us absolutely nothing – it will go down in history as one of the worst deals ever negotiated. Another humiliation came when president Obama drew a red line in Syria – and the whole world knew it meant absolutely nothing.In Libya, our consulate, the symbol of American prestige around the globe, was brought down in flames. America is far less safe and the world is far less stable than when Obama made the decision to put Hillary Clinton in charge of America’s foreign policy.Let’s defeat her in November.I am certain that it was a decision that President Obama truly regrets. Her bad instincts and her bad judgement, something pointed out by Bernie Sanders, are what caused so many of the disasters unfolding today.Let’s review the record.In 2009, pre-Hillary, ISIS was not even on the map. Libya was stable. Egypt was peaceful. Iraq was seeing really a big, big reduction in violence. Iran was being choked by sanctions. Syria was somewhat under control.After four years of Hillary Clinton, what do we have?ISIS has spread across the region, and the entire world. Libya is in ruins, and our Ambassador and his staff were left helpless to die at the hands of savage killers. Egypt was turned over to the radical Muslim brotherhood, forcing the military to retake control.Iraq is in chaos. Iran is on the path to nuclear weapons. Syria is engulfed in a civil war and a refugee crisis now threatens the West. After fifteen years of wars in the Middle East, after trillions of dollars spent and thousands of lives lost, the situation is worse than it has ever been before.This is the legacy of Hillary Clinton: death, destruction, terrorism and weakness.But Hillary Clinton’s legacy does not have to be America’s legacy. The problems we face now – poverty and violence at home, war and destruction abroad – will last only as long as we continue relying on the same politicians who created them in the first place. A change in leadership is required to produce a change in outcomes.Tonight, I will share with you my plan of action for America.The most important difference between our plan and that of our opponent, is that our plan will put America First. Americanism, not globalism, will be our credo. As long as we are led by politicians who will not put America First, then we can be assured that other nations will not treat America with respect, the respect that we deserve.The American People will come first once again. My plan will begin with safety at home – which means safe neighborhoods, secure borders, and protection from terrorism. There can be no prosperity without law and order.On the economy, I will outline reforms to add millions of new jobs and trillions in new wealth that can be used to rebuild America.A number of these reforms that I will outline tonight will be opposed by some of our nation’s most powerful special interests. That is because these interests have rigged our political and economic system for their exclusive benefit. Believe me. It’s for their benefit.Big business, elite media and major donors are lining up behind the campaign of my opponent because they know she will keep our rigged system in place. They are throwing money at her because they have total control over every single thing she does. She is their puppet, and they pull the strings.That is why Hillary Clinton’s message is that things will never change – never ever. My message is that things have to change – and they have to change right now. Every day I wake up determined to deliver a better life for the people all across this nation that have been ignored, neglected and abandoned.I have visited the laid-off factory workers, and the communities crushed by our horrible and unfair trade deals. These are the forgotten men and women of our country, and they are forgotten, but they are not going to be forgotten long. These are people who work hard but no longer have a voice.I AM YOUR VOICE.I have embraced crying mothers who have lost their children because our politicians put their personal agendas before the national good. I have no patience for injustice, no tolerance for government incompetence, no sympathy for leaders who fail their citizens.When innocent people suffer, because our political system lacks the will, or the courage, or the basic decency to enforce our laws – or still worse, has sold out to some corporate lobbyist for cash – I am not able to look the other way. And I won’t look the other way.And when a Secretary of State illegally stores her emails on a private server, deletes 33,000 of them so the authorities can’t see her crime, puts our country at risk, lies about it in every different form and faces no consequence – I know that corruption has reached a level like never ever before in our country.When the FBI Director says that the Secretary of State was “extremely careless” and “negligent,” in handling our classified secrets, I also know that these terms are minor compared to what she actually did. They were just used to save her from facing justice for her terrible, terrible crimes.In fact, her single greatest accomplishment may be committing such an egregious crime and getting away with it – especially when others, who have done far less, have paid so dearly. When that same Secretary of State rakes in millions and millions of dollars trading access and favors to special interests and foreign powers I know the time for action has come.I have joined the political arena so that the powerful can no longer beat up on people who cannot defend themselves. Nobody knows the system better than me, which is why I alone can fix it. I have seen firsthand how the system is rigged against our citizens, just like it was rigged against Bernie Sanders – he never had a chance. Never had a chance.But his supporters will join our movement, because we will fix his biggest single issue: trade deals that strip our country of its jobs and strip us of our wealth as a country. Millions of Democrats will join our movement because we are going to fix the system so it works fairly, and justly, for each and every American.In this cause, I am proud to have at my side the next Vice President of the United States: Governor Mike Pence of Indiana.We will bring the same economic success to America that Mike brought to Indiana which is amazing. He is a man of character and accomplishment. He is the man for the job.The first task for our new Administration will be to liberate our citizens from the crime and terrorism and lawlessness that threatens our communities.America was shocked to its core when our police officers in Dallas were so brutally executed. Immediately after Dallas, we have seen continued threats and violence against our law enforcement officials. Law officers have been shot or killed in recent days in Georgia, Missouri, Wisconsin, Kansas, Michigan and Tennessee.On Sunday, more police were gunned down in Baton Rouge, Louisiana. Three were killed, and three were very, very badly injured.　An attack on law enforcement is an attack on all Americans. I have a message to every last person threatening the peace on our streets and the safety of our police: when I take the oath of office next year, I will restore law and order to our country. Believe me. Believe me.I will work with, and appoint, the best and brightest prosecutors and law enforcement officials to get the job properly done. In this race for the White House, I am the Law And Order candidate. The irresponsible rhetoric of our President, who has used the pulpit of the presidency to divide us by race and color, has made America a more dangerous environment than frankly, I have ever seen and anybody in this room has ever watched or seen.This Administration has failed America’s inner cities. Remember. It has failed America’s inner cities. It’s failed them on education. It’s failed them on jobs. It’s failed them on crime. It’s failed them in every way and on every single level.When I am President, I will work to ensure that all of our kids are treated equally, and protected equally.Every action I take, I will ask myself: does this make better for young Americans in Baltimore, in Chicago, in Detroit, in Ferguson who have really in every way, folks, the same right to live out their dreams as any other child in America? Any other child...To make life safe for all our citizens, we must also address the growing threats we face from outside the country: we are going to defeat the barbarians of ISIS and we’re going to defeat them fast. Once again, France is the victim of brutal Islamic terrorism.Men, women and children viciously mowed down. Lives ruined. Families ripped apart. A nation in mourning.The damage and devastation that can be inflicted by Islamic radicals has been proven over and over – at the World Trade Center, at an office party in San Bernardino, at the Boston Marathon, at a military recruiting center in Chattanooga, and many many other locations.Only weeks ago, in Orlando, Florida, 49 wonderful Americans were savagely murdered by an Islamic terrorist. This time, the terrorist targeted LGBTQ community.No good. We are going to stop it.As your President, I will do everything in my power to protect our LGBTQ citizens from the violence and oppression of a hateful foreign ideology. Believe me.　I have to say as a republican it is so nice to hear your cheering about what I just said. Thank you. To protect us from terrorism, we need to focus on three things.We must have the best, absolutely the best gathering of intelligence anywhere in the world. The best. We must abandon the failed policy of nation-building and regime change that Hillary Clinton pushed in Iraq, in Libya, in Egypt and in Syria.Instead, we must work with all of our allies who share our goal of destroying ISIS and stamping out Islamic terrorism and doing it now and doing it quickly. We’re going to win and we’re going to win fast. This includes working with our greatest ally in the region, the State of Israel.Recently, I have said that NATO was obsolete, because it did not properly cover terror, and also, that many of the member countries were not paying their fair share. As usual, the United States has been picking up the cost.　Shortly thereafter, it was announced that NATO will be setting up a new program in order to combat terrorism -- a true step in the right direction.Lastly, and very importantly, we must immediately suspend immigration from any nation that has been compromised by terrorism until such time as proven vetting mechanisms have been put in place. We don’t want them in our country.My opponent has called for a radical 550% increase in Syrian, think of this, think of　this,　this is not believable but this is what’s happening, a 550% increase in Syrian refugees on top of the existing massive refugee flows coming into our country already under the leadership of President Obama. She proposes this despite the fact that there’s no way to screen these refugees in order to find out who they are or where they come from. I only want to admit individuals into our country who will support our values and love our people.Anyone who endorses violence, hatred or oppression is not welcome in our country　and never ever will be.Decades of record immigration have produced lower wages and higher unemployment for our citizens, especially for African-American and Latino workers. We are going to have an immigration system that works, but one that works for the American people. On Monday, we heard from three parents whose children were killed by illegal immigrants—Mary Ann Mendoza, Sabine Durden, and my friend Jamiel Shaw. They are just three brave representatives of many thousands who have suffered so gravely.Of all my travels in this country, nothing has affected me more, nothing even close I have to tell you, than the time I have spent with the mothers and fathers who have lost their children to violence spilling across our borders, which we can solve, we have to solve them.These families have no special interests to represent them. There are no demonstrators to protect them, and certainly none to protest on their behalf. My opponent will never meet with them, or share in their pain. Believe me. Instead, my opponent wants Sanctuary Cities.But where was the sanctuary for Kate Steinle? Where was the Sanctuary for the children of Mary Ann, and Sabine, and Jamiel? Where was the Sanctuary for all the other Americans who have been so brutally murdered, and who have suffered so so horribly?These wounded American families have been alone. But they are not alone any longer. Tonight, this candidate and the whole nation stand in their corner to support them, to send them our love, and to pledge in their honor that we will save countless more families from suffering and the same awful fate.We are going to build a great border wall to stop illegal immigration, to stop the gangs and the violence, and to stop the drugs from pouring into our communities. I have been honored to receive the endorsement of America’s Border Patrol Agents, and will work directly with them to protect the integrity of our lawful, lawful, lawful immigration system.By ending catch-and-release on the border, we will end the cycle of human smuggling and violence. Illegal border crossings will go down. We will stop it, it won’t be happening very much any more. Believe me. Peace will be restored. By enforcing the rules for millions who overstay their visas, our laws will finally receive the respect that they deserve.Tonight, I want every American whose demands for immigration security have been denied – and every politician who has denied them – to listen very, very closely to the words I am about to say.On January 20th of 2017, the day I take the oath of office, Americans will finally wake up in a country where the laws of the United States are enforced. We are going to be considerate and compassionate to everyone.But my greatest compassion will be for our own struggling citizens. My plan is the exact opposite of the radical and dangerous immigration policy of Hillary Clinton. Americans want relief from uncontrolled immigration which is what we have now. Communities want relief.Yet Hillary Clinton is proposing mass amnesty, mass immigration, and mass lawlessness. Her plan will overwhelm your schools and hospitals, further reduce your jobs and wages, and make it harder for recent immigrants to escape the tremendous cycle of poverty that they are going through right now and make it almost impossible for them to join the middle class.I have a different vision for our workers. It begins with a new, fair trade policy that protects our jobs and stands up to countries that cheat of which there many. It’s been a signature message of my campaign from day one, and it will be a signature feature of my presidency from the moment I take the oath of office.I have made billions of dollars in business making deals – now I’m going to make our country rich again. Using the greatest business people in the world which our country has, I am going to turn our bad trade agreements into great trade agreements. America has lost nearly one-third of its manufacturing jobs since 1997, following the enactment of disastrous trade deals supported by Bill and Hillary Clinton.Remember, it was Bill Clinton who signed NAFTA, one of the worst economic deals ever made by our country or frankly, any other country.Never ever again.I am going to bring back our jobs to Ohio, and Pennsylvania, and New York, and Michigan and to all of America – and I am not going to let companies move to other countries, firing their employees along the way, without consequence. Not going to happen any more.My opponent, on the other hand, has supported virtually every trade agreement that has been destroying our middle class. She supported NAFTA, and she supported China’s entrance into the World Trade Organization – another one of her husband’s colossal mistakes and disasters.She supported the job-killing trade deal with South Korea. She has supported the Trans-Pacific Partnership – which will not only destroy our manufacturing, but it will make America subject to the rulings of foreign governments. And it’s not going to happen. I pledge to never sign any trade agreement that hurts our workers, or that diminishes our freedom and our independence. We will never ever sign bad trade deals. America first again. America first.　Instead, I will make individual deals with individual countries.No longer will we enter into these massive transactions, with many countries, that are thousands of pages long – and which no one from our country even reads or understands.　We are going to enforce all trade violations against any country that cheats.This includes stopping China’s outrageous theft of intellectual property, along with their illegal product dumping, and their devastating currency manipulation. They are the greatest that ever came about. They are the greatest currency manipulators ever.　Our horrible trade agreements with China, and many others, will be totally renegotiated. That includes renegotiating NAFTA to get a much better deal for America – and we’ll walk away if we don’t get that kind of deal. Our country is going to start building and making things again.Next comes the reform of our tax laws, regulations and energy rules. While Hillary Clinton plans a massive, and I mean massive tax increase, I have proposed the largest tax reduction of any candidate who has run for president this year – Democrat or Republican. Middle-income Americans and businesses will experience profound relief, and taxes will be greatly simplified for everyone. I mean everyone.America is one of the highest-taxed nations in the world. Reducing taxes will cause new companies and new jobs to come roaring back into our country. Believe me. It will happen and it will happen fast. Then we are going to deal with the issue of regulation, one of the greatest job-killers of them all. Excessive regulation is costing our country as much as 2 trillion dollars a year, and we will end it very, very quickly.We are going to lift the restrictions on the production of American energy. This will produce more than 20 trillion dollars in job-creating economic activity over the next four decades.My opponent, on the other hand, wants to put the great miners and the great steel workers of our country out of work and out of business. That will never happen when Donald J Trump is President. Our steel workers and our miners are going back to work again. With these new economic policies, trillions of trillions of dollars will start flowing into our country.This new wealth will improve the quality of life for all Americans. We will build the roads, highways, bridges, tunnels, airports, and the railways of tomorrow. This, in turn, will create millions of more jobs. We will rescue kids from failing schools by helping their parents send them to a safe school of their choice.My opponent would rather protect bureaucrats than serve American children. And that’s what she’s doing and that’s what she’s done. We will repeal and replace disastrous Obamacare. You will be able to choose your own doctor again. And we will fix TSA at the airports which is a total disaster.We going to work with all of our students who are drowning in debt to take the pressure off these young people just starting out their adult lives. Tremendous problem. We will completely rebuild our depleted military, and the countries that we are protecting, at a massive cost to us, will be asked to pay their fair share.We will take care of our great Veterans like they have never been taken care of before. My just-released Ten Point Plan has received tremendous veteran support. We will guarantee those who serve this country will be able to visit the doctor or hospital of their choice without waiting five days on a line and dying.My opponent dismissed the VA scandal – one more sign of how out of touch she really is. We are going to ask every Department Head in government to provide a list of wasteful spending on projects that we can eliminate in my first 100 days. The politicians have talked about this for years, but I’m going to do it. We are going to appoint justices to the United States Supreme Court who will uphold our laws and our Constitution.The replacement of our beloved Justice Scalia will be a person of similar views, principles, and judicial philosophies. Very important. This will be one of the most important issues decided by this election. My opponent wants to essentially abolish the 2nd amendment. I, on the other hand, received the early and strong endorsement of the National Rifle Association and will protect the right of all Americans to keep their families safe.At this moment, I would like to thank the evangelical and religious community because, I tell you what, the support they have given me — and I'm not sure I totally deserve it — has been so amazing. And has been such a big reason for me being here tonight. True. So true. They have much to contribute to our politics, yet our laws prevent you from speaking your minds from your own pulpits.An amendment, pushed by Lyndon Johnson, many years ago, threatens religious institutions with a loss of their tax-exempt status if they openly advocate their political views. Their voice is taken away.I am going to work very hard to repeal that language and to protect free speech for all Americans.We can accomplish these great things, and so much more – all we need to do is start believing in ourselves and in our country again. Start believing. It is time to show the whole world that America Is Back – bigger, and better and stronger than ever before.In this journey, I'm so lucky to have at my side my wife Melania and my wonderful children, Don, Ivanka, Eric, Tiffany, and Barron: you will always be my greatest source of pride and joy. And by the way, Melania and Ivanka, did they do a job? My Dad, Fred Trump, was the smartest and hardest working man I ever knew. I wonder sometimes what he’d say if he were here to see this and to see me tonight.It’s because of him that I learned, from my youngest age, to respect the dignity of work and the dignity of working people. He was a guy most comfortable in the company of bricklayers, and carpenters, and electricians and I have a lot of that in me also. I love those people.Then there’s my mother, Mary. She was strong, but also warm and fairminded. She was a truly great mother. She was also one of the most honest and charitable people that I have ever known, and a great, great judge of character. She could pick them out from anywhere.To my sisters Mary Anne and Elizabeth, my brother Robert and my late brother Fred, I will always give you my love—you are most special to me. I have had a truly great life in business.But now, my sole and exclusive mission is to go to work for our country – to go to work for you. It’s time to deliver a victory for the American people. We don’t win any more, but we are going to start winning again.But to do that, we must break free from the petty politics of the past. America is a nation of believers, dreamers, and strivers that is being led by a group of censors, critics and cynics.Remember: all of the people telling you that you can’t have the country you want, are the same people that wouldn’t stand, I mean they said Trump does not have a chance of being here tonight, not a chance, the same people. We love defeating those people, don't we? Love it.No longer can we rely on those same people in the media, and politics, who will say anything to keep our rigged system in place. Instead, we must choose to believe In America. History is watching us now. We don’t have much time, but history is watching.It’s waiting to see if we will rise to the occasion, and if we will show the whole world that America is still free and independent and strong. I'm asking for your support tonight so that I can be your champion in the White House. And I will be your champion.My opponent asks her supporters to recite a three-word loyalty pledge. It reads: “I’m With Her”. I choose to recite a different pledge.My pledge reads: “I’M WITH YOU – THE AMERICAN PEOPLE.”I am your voice.So to every parent who dreams for their child, and every child who dreams for their future, I say these words to you tonight: I am with you, I will fight for you, and I will win for you.To all Americans tonight, in all of our cities and in all of our towns, I make this promise: We Will Make America Strong Again.We Will Make America Proud Again.We Will Make America Safe Again.And We Will Make America Great Again.God bless You And Good Night.　I love you.</td>\n","            </tr>\n","            <tr>\n","                        <th id=\"T_e6945576_4dd7_11ec_9b15_0242ac1c0002level0_row1\" class=\"row_heading level0 row1\" >1</th>\n","                        <td id=\"T_e6945576_4dd7_11ec_9b15_0242ac1c0002row1_col0\" class=\"data row1 col0\" >result summary</td>\n","                        <td id=\"T_e6945576_4dd7_11ec_9b15_0242ac1c0002row1_col1\" class=\"data row1 col1\" >Friends, delegates and fellow Americans: I humbly and gratefully accept your nomination for the presidency of the United States.Who would have believed that when we started this journey on June 16th of last year, we – and I say we because we are a team – would have received almost 14 million votes, the most in the history of the Republican Party, and that the Republican Party would get 60 percent more votes than it received eight years ago. Who would have believed this? Who would have believed this? The Democrats, on the other hand, received 20 percent fewer votes than they got four years ago.Together, we will lead our party back to the White House, and we will lead our country back to safety, prosperity, and peace. We will be a country of generosity and warmth. But we will also be a country of law and order.Our Convention occurs at a moment of crisis for our nation. Millions of Democrats will join our movement because we are going to fix the system so it works fairly, and justly, for each and every American. We will completely rebuild our depleted military, and the countries that we are protecting, at a massive cost to us, will be asked to pay their fair share. I'm asking for your support tonight so that I can be your champion in the White House.</td>\n","            </tr>\n","            <tr>\n","                        <th id=\"T_e6945576_4dd7_11ec_9b15_0242ac1c0002level0_row2\" class=\"row_heading level0 row2\" >2</th>\n","                        <td id=\"T_e6945576_4dd7_11ec_9b15_0242ac1c0002row2_col0\" class=\"data row2 col0\" >result summary:SL</td>\n","                        <td id=\"T_e6945576_4dd7_11ec_9b15_0242ac1c0002row2_col1\" class=\"data row2 col1\" >Friends, delegates and fellow Americans: I humbly and gratefully accept your nomination for the presidency of the United States.Who would have believed that when we started this journey on June 16th of last year, we – and I say we because we are a team – would have received almost 14 million votes, the most in the history of the Republican Party, and that the Republican Party would get 60 percent more votes than it received eight years ago. We will be a country of generosity and warmth. But we will also be a country of law and order.I have a message for all of you: the crime and violence that today afflicts our nation will soon, and I mean very soon, come to an end.Again, I will tell you the plain facts that have been edited out of your nightly news and your morning newspaper: Nearly Four in 10 African-American children are living in poverty, while 58% of African-American youth are now not employed.This was just prior to the signing of the Iran deal, which gave back to Iran 150 billion dollars and gave us absolutely nothing – it will go down in history as one of the worst deals ever negotiated.On the economy, I will outline reforms to add millions of new jobs and trillions in new wealth that can be used to rebuild America. We will completely rebuild our depleted military, and the countries that we are protecting, at a massive cost to us, will be asked to pay their fair share.We can accomplish these great things, and so much more – all we need to do is start believing in ourselves and in our country again.</td>\n","            </tr>\n","            <tr>\n","                        <th id=\"T_e6945576_4dd7_11ec_9b15_0242ac1c0002level0_row3\" class=\"row_heading level0 row3\" >3</th>\n","                        <td id=\"T_e6945576_4dd7_11ec_9b15_0242ac1c0002row3_col0\" class=\"data row3 col0\" >bert_extra_summary</td>\n","                        <td id=\"T_e6945576_4dd7_11ec_9b15_0242ac1c0002row3_col1\" class=\"data row3 col1\" >Friends, delegates and fellow Americans: I humbly and gratefully accept your nomination for the presidency of the United States. Who would have believed that when we started this journey on June 16th of last year, we – and I say we because we are a team – would have received almost 14 million votes, the most in the history of the Republican Party, and that the Republican Party would get 60 percent more votes than it received eight years ago. We will be a country of generosity and warmth. But we will also be a country of law and order. So if you want to hear the corporate spin, the carefully-crafted lies, and the media myths the Democrats are holding their convention next week. And almost 4,000 have been killed in the Chicago area since he took office. They are being released by the tens of thousands into our communities with no regard for the impact on public safety or resources. Again, I will tell you the plain facts that have been edited out of your nightly news and your morning newspaper: Nearly Four in 10 African-American children are living in poverty, while 58% of African-American youth are now not employed. ISIS has spread across the region, and the entire world. A change in leadership is required to produce a change in outcomes. As long as we are led by politicians who will not put America First, then we can be assured that other nations will not treat America with respect, the respect that we deserve. That is because these interests have rigged our political and economic system for their exclusive benefit. She is their puppet, and they pull the strings. When innocent people suffer, because our political system lacks the will, or the courage, or the basic decency to enforce our laws – or still worse, has sold out to some corporate lobbyist for cash – I am not able to look the other way. Millions of Democrats will join our movement because we are going to fix the system so it works fairly, and justly, for each and every American. Shortly thereafter, it was announced that NATO will be setting up a new program in order to combat terrorism -- a true step in the right direction. There are no demonstrators to protect them, and certainly none to protest on their behalf. On January 20th of 2017, the day I take the oath of office, Americans will finally wake up in a country where the laws of the United States are enforced. Reducing taxes will cause new companies and new jobs to come roaring back into our country. You will be able to choose your own doctor again. We will take care of our great Veterans like they have never been taken care of before. We are going to ask every Department Head in government to provide a list of wasteful spending on projects that we can eliminate in my first 100 days. We can accomplish these great things, and so much more – all we need to do is start believing in ourselves and in our country again. To my sisters Mary Anne and Elizabeth, my brother Robert and my late brother Fred, I will always give you my love—you are most special to me. We don’t win any more, but we are going to start winning again. We don’t have much time, but history is watching.</td>\n","            </tr>\n","    </tbody></table>"],"text/plain":["<pandas.io.formats.style.Styler at 0x7fe1ce128090>"]},"metadata":{},"execution_count":17}]},{"cell_type":"markdown","metadata":{"id":"xJxT0PugnLLb"},"source":["# **備考**\n","- [**【自然言語処理（日本語）】自動要約ライブラリのpysummarizationを使う為の準備と実装**](https://zerofromlight.com/blogs/detail/35/)\n","- [**トランプ氏受諾演説（英語全文）2016年7月23日**](https://www3.nhk.or.jp/news/special/2016-presidential-election/republic4.html)\n","- [**bert-extractive-summarizer 0.8.1**](https://pypi.org/project/bert-extractive-summarizer/)\n","- [**【python】 bert-extractive-summarizerを使った文章要約**](https://kagglenote.com/ml-tips/bert-extractive-summarizer/)"]}]}