web crawling technique in VB.NET

Web Scraping - Extract all links from a web page using VB.NET

This article explains another technique in Web Scraping, which has been an important function of search engine crawling - extraction of all links for any given URL. This is quite a simple procedure, especially when done using Regular Expressions. The HTML content from any given url is downloaded as a string, and all occurences of hyperlinks are extracted from it.

Relevance:

Generate Google Sitemap for ASP.NET website using VB.NET

A sitemap is a list of pages available on a website. This was used to help visitors to provide an overall navigation of the website, but now sitemaps are mainly used for listing pages and their updates to search engines. Sitemaps are no more in HTML format, but in plain text format or commonly HTML.

Relevance:

Display a custom graphic visitor counter on your ASP.NET website

This article explains how to add a graphic visitor counter to your website by adding a simple ASPX webpage with few lines of programming. You'll no more be required to add a third party free graphic counter utilities for your ASP.NET web site.

Relevance:

Simple Website Scraping: Extract all text contents from webpage

Web Scraping or Web Data extraction is a software technique for extracting information from web pages. There are different types of web scraping, and a most common one is the web crawling done by search engines. The text content of the website will be extracted from web pages, and will be indexed for searching. This article explains a simple method of extracting text content using C# and Regul...

Relevance:

How does META Description affect your website search rank?

I found the META Description element in a webpage to be very useful element of a webpage. The Description content was displayed as it is on search engine results. Everytime I created a website, I used this description tag on all pages, just writing what this website was mainly meant for, or what the company serves through the result. But sooner I observed that this is limiting my results on th...

Relevance:

Web Designing Tips - How to make your web layouts clean and search engine friendly

The TechWorld is now traversing from HTML 4 to HTML 5 using great features and advantages of the later, but still a major share of web still relies on the former version to keep compatibility and to meet with greater number of incompatible of browsers still in use. HTML5/CSS3 is greatly picked by web enthusiasts and web designing companies, but yet not reached the commercial production in larg...

Relevance:

New LulzSec hack leaks 62,000 web logins

Only hours after embarrassing the CIA by downing its website, hacking jokesters LulzSec have issued another self-declared indictment of the Internet’s woeful security, leaking a database of 62,000 stolen passwords and user names.

Relevance:

Google Builds Developer Tool to Flag Web App Vulnerabilities

Google (GOOG) has released an experimental extension for its Chrome browser that developers can use to scan their Web applications and flag code that could make them vulnerable to malware attacks.

Relevance:

How i can add flv streaming video on my web page.

hello sir, i want to add flv streaming video in my web page. (Not from youtube.com etc) i have convert video to flv. but can not add it on web page ... Please guide me

Relevance:

Problem in displaying Hindi font in website

Sir, recently i am working on a website in which hindi language is also used. Now when i open the website in Mozilla firefox, its looking well but in Internet Explorer, the hindi font is creating pro...

Relevance:

Using hindi text in web site

sir may name is nilesh gupta and i have developing a web site but the problem is hindi text font that is the hindi font not support the web page plz help me thanks

Relevance:

Generate High Quality Favicon.ico

A favicon (short for favorites icon), also known as a website icon, shortcut icon, url icon, or bookmark icon is a 16×16, 32×32 or 64×64 pixel square icon associated with a particular website or webpage. A web designer can create such an icon and install it into a website (or webpage) by several means, and most graphical web browsers will then make use of it.

Relevance:

Google App Engine - Getting started

With App Engine, we can build web applications using the Python/Java programming language, and our application runs on Google's scalable infrastructure, and uses large-scale persistent storage and services. The Python Runtime Environment App Engine includes a simple web application framework, called webapp, to make it easy to get started.App Engine supports Python 2.5. Our app take adva...

Relevance:

Snippet: Get Browser Name from UserAgent String

When you want to save logs on your website for any events like visits, errors, etc., it would be good if you add the browser name also. In case of errors, this information will do great for you, because client-side script errors and malfunctions might be browser dependant, and you would have to really debug them on those browsers in some cases.

Relevance:

Uploading a file to the AppEngine BlobStore (Python)

Google App Engine provides a Blobstore API that allows our app to serve 'Blobs' that are much larger in size say between 1 mb and 2 gb.Blobs are created by uploading a file through an HTTP request using a html form .When the form is submitted, the Google App Engine Blobstore creates a blob from the uploaded file returning the blob key that can be used to process the blob

Relevance:

Adding the MapReduce library to your application (Python code)

MapReduce is a patented software framework introduced by Google to support distributed computing on large data sets on cluster of computers. The framework is inspired by the map and reduce functions in functional programming, although their purpose in the MapReduce framework is not the same as their original forms.

Relevance:

T-SQL Function: How to parse UserAgent to extract Browser Name

As you parse the UserAgent string in the server-side VB.NET or C#.NET code, it is possible to parse it using T-SQL programming. This would be extremely useful when your web application is more SQL Server dependant - having most of the business logic as stored procedures and functions. The only difference here is, as in ASP.NET, the UserAgent string is not accessible directly inside T...

Relevance:

Tableless layouts using floating DIV

In the current web designing trend, the tableless web layouts are very popular and widely used. This article explains how to create tableless layouts using DIV elements. The technique very well substitutes the still commonly used layouts using tables and nested tables.

Relevance:

Image Uploading and High Quality Resizing

Uploading of images and resizing (scaling) of them is a very common utility application. Various applications for this function are - Photo thumbnails, profile photos, stock photograph images like Flickr, etc. The System.Drawing namespace provides a built-in thumbnail creation function, but here is a code snippet to resize images preserving its original aspect ratio, maintaining high qua...

Relevance:

Embedding Images into emails using System.Net.Mail

The most common way to insert the image into the HTML Body of the email using IMG elements with SRC attribute set to an image uploaded on your website or any internet source. This works fine with all online webmails like yahoo, or gmail, or even on your Outlook when you are connected to internet. Due to security issues, such images will get blocked on the webmails or Outlook unless you authori...

Relevance:

Sending Emails from ASP.NET 2.0

Sending out emails is a common requirement in every web application. This could range from a simple Contact Us form, to daily digest email to all subscribers. In ASP.NET, System.Net.Mail namespace provides all necessary functions of sending emails. In earlier versions of .NET, System.Web.Mail, but the new namespace provides extensive and powerful interfaces for sending out emai...

Relevance:

ASP.NET Login based controls

This articles explains how to use the ASP.NET Membership and Roles features to control various parts of the page according the logged in user. By using these features, we can create templates for anonymous users, logged-in users, role-based templates, and also login and online status. Most simple case would be to display Login link when no user is logged in, and the same would turn as Logout li...

Relevance:

Best Way of Creating High Quality Favicons

You don't always need to depend on online favicon designers to create a good favicon for your website. If website is an identity for you or your business, favicon or favorites icon or shortcut icon is an identity for your website. A favicon represents your website in almost all web 2.0 integrations and posts.

Relevance:

Google challenge to Microsoft software empire

The battle between Google and Microsoft to shape the future of personal computing has stepped up a gear after Google unveiled an internet-centric laptop that it said would offer a cheaper alternative to the traditional PC.

Relevance:

Opera is the oldest browser, and it is still surviving

Jon S Von Tetzchner and a colleague, Geir Ivarsoy, developed a Web browser while working for Telenor in 1994. In 1995, they founded Opera Software and launched their first public browser, Opera, a year later. It is the oldest-surviving browser company. The 42-year-old Von Tetzchner may have stepped down as CEO of Opera Software in January, but is still actively involved with the firm’s po...

Relevance:

Now, software that enables everyone to explore the Sun

ESA has developed a new software that makes the entire library of images from the SOHO solar and heliospheric observatory available online to everyone, everywhere at anytime.

Relevance:

Multiple Gmail accounts just got a lot easier to manage

Google's announced yet another awesome Gmail feature today. Called e-mail delegation, the feature will allow you to easily manage multiple Gmail accounts without signing in and out of Gmail and switching accounts manually.

Relevance:

Windows Phone 7 Mango to add HTML5 and support for Silverlight

Microsoft is believed to prepare a major update to its Windows Phone 7 in order to catch up to rivals in web browsing most of all. Codenamed “Mango”, the update is supposed to add HTML5 to the browser and to add support for Silverlight, probably as a plugin. The current update would be larger than the other one or two updates expected to appear early in 2011. it would be somehow equ...

Relevance:

Microsoft's Steve Ballmer predicts virtual avatars for software

NEW DELHI: Steve Ballmer's future in Microsoft may have become uncertain after a prominent hedge fund manager called for his resignation on Thursday, but that didn't stop the beefy, boisterous pal of Bill Gates from waxing eloquent about the tech industry's future.

Relevance:

Jobs announces Apple's iCloud storage service

Relevance:

Oracle Fixes 17 Bugs in Java Security Update

Oracle has issued an update to Java SE that fixes a number of critical bugs in the widely used Internet software.

Relevance:

A Decade Later, W3C Finalizes CSS 2.1

The Web's Cascading Style Sheets now can be rendered consistently across a large number of devices. The World Wide Web Consortium has updated its widely used specifications for formatting the look and feel of Web pages, a standard known as CSS (Cascading Style Sheets). After almost a decade of work, the W3C's CSS Working Group has published CSS version 2.1 ...

Relevance:

Google Chrome browser adds malware download protection

Google updated Chrome to version 12, adding a new tool that warns users when they've downloaded files from dangerous websites.

Relevance:

MongoDB Competes on Speed and Flexibility

While debate rages on over the value of nonrelational, or NoSQL, databases, two case studies presented at a New York conference this week point to the benefits of using the MongoDB non-SQL data store instead of a standard relational database.

Relevance:

Google drops search portals for Linux and Mac

Fans of Linux, Microsoft and Macs used to be able to search for information about those topics on Google using specialized search tools that narrowed the results to a focused set of highly relevant Web sites.

Relevance:

Android Market tells you which apps work on your device

With hundreds of different smartphone models and a growing number of tablets that run Google’s Android operating system, fragmentation continues to challenge. Some devices can run certain apps, while others can’t. Google begin taking steps to address this issue last year, and more recently, has added a new function to its web-based Android Market. Consumers can now see if an applica...

Relevance:

Many Malaysian Government Sites Hacked

Malaysia's Communications and Multimedia Commission said that 51 websites in the .gov.my domain were attacked beginning late Wednesday, and that 41 of the sites suffered various levels of disruption.

Relevance:

Yahoo Releases Search Tools for IPhone, Android Apps

Yahoo wants to help people find mobile applications and information about them. On Thursday, the company is unveiling a feature in its search engine called App Search, as well as application search tools for Android and iPhone devices called AppSpot.

Relevance:

Microsoft, Skype Deal Gets U.S. Clearance

Microsoft (MSFT) has received clearance from U.S. antitrust regulators for its proposed purchase of Internet telephony company Skype.

Relevance:

Facebook to take top spot in U.S. display ad market

Facebook's U.S. advertising revenue will total roughly $2.2 billion in 2011, displacing Yahoo Inc to collect the biggest slice of online display advertising dollars, according to a new study.

Relevance:

Google signs up British Library to books project

Google plans to digitize a quarter of a million books from the British Library's collections covering a period from the French Revolution to the end of slavery as part of its ambitious books project.

Relevance:

Adobe updates Flash Builder and Flex development tools

Adobe today is releasing its Flash Builder 4.5.1 development tool and Flex 4.5.1 framework, boosting mobile application development support.

Relevance:

experienced programming consultants for hire !!!

web crawling technique in VB.NET