GBrowse: Difference between revisions

From Alliance Doc
Jump to navigation Jump to search
No edit summary
No edit summary
 
(34 intermediate revisions by 4 users not shown)
Line 1: Line 1:
{{Draft}}
<languages />
== Introduction ==
<translate>
GBrowse is a combination of database and interactive web pages for manipulating and displaying annotations on genomes. It requires a web interface to display. GBrowse has been installed on cedar and the way we installed that might be different from others. Here we explain briefly how we setup Gbrowse specifically on cedar. For more information about Gbrowse in general and how it works please take a look at Gbrowse official website: http://gmod.org/wiki/GBrowse


== Introduction == <!--T:1-->


==Gbrowse Installation==
<!--T:2-->
We have installed GBrowse on a server which has access to /home and /project directories of cedar. The server is called "cedar portal" and its web address is "https://gateway.cedar.computecanada.ca". On this server we have installed apache-2.4.6 web server with apache itk module. In order to be able to access files and directories of the the users while maintaining the security each research group who is interested to have GBrowse will get a specific shared account. The itk module is used to assign uid of the shared account for each specific apache vhost. The GBrowse then will be installed on that vhost. Each vhost will get a specific port number to connect. Therefore for each research group there is one GBrowse instance. Every GBrowse instance act as a user with uid of that shared account. In this way GBrowse is able to read files of users withing a research group. If you need GBrowse on cedar portal please send a request to support@computecanada.ca
GBrowse is a combination of database and interactive web pages for manipulating and displaying annotations on genomes. It requires a web interface to display. GBrowse is installed on [[Cedar]]. The web address of the installation is https://gateway.cedar.computecanada.ca.


==GBrowse Configuration Setup==
<!--T:3-->
===Gbrowse Config Files===
The Cedar installation differs in some ways from the standard GBrowse setup described at the official website: http://gmod.org/wiki/GBrowse, particularly with regard to authentication and authorization.
Since Gbrowse needs to be able to read config files of all users within a group, the config files for each group are installed in /project and on following directories:


/project/GROUPID/gbrowse/USERID/conf
==Requesting access to GBrowse== <!--T:4-->


where GROUPID is your group id and USERID is the your username. There is a symbolic link from this directory to ${HOME}/gbrowse/conf just for simplicity so that you can get access to files within this directory easier. Files in this directory should be readable for all member of the group therefore, please do not change the group permission of files in this directory.
<!--T:5-->
In order for GBrowse to be able to access your files and directories, our staff will create a shared account for each research group that requests access to GBrowse. While using GBrowse, any member of a research group can read GBrowse config files and input files belonging to any other member of that group. If you wish to use GBrowse, the Principal Investigator (PI) of your group must agree to this change from the usual file security practices. Have the PI write to our [[technical support]] indicating that they want a GBrowse account to be created for the group, and that they understand the implications of a shared account.


===Setup Database===
<!--T:6-->
GBrowse uses two sources of input, files and database. Before using GBrowse users require to setup their own database. More information about database of computecanada is here. If you decide to use MySQL as your database you can use the following setup in your corresponding GBrowse config files to make MySQL connection from your GBrowse:
You must also have a database account on Cedar. If you already have one, please give the name of the database in your email. If you do not already have a database account, please read [[Database servers]] carefully and answer the questions given there for setting up a database.


                    db_args      =     -adaptor DBI::mysql
==Setting up GBrowse== <!--T:7-->
                    -dsn [database name];mysql_read_default_file=/project/GROUPID/gbrowse/USERID/conf/.my.cnf
                    -user [username]


===Config files=== <!--T:8-->


where [username] is the corresponding user name and [database name] is the name of the database.
<!--T:9-->
Since GBrowse needs to be able to read config files of all users within a group, place your GBrowse config files in the following directory:
 
<!--T:10-->
/project/''GROUPID''/gbrowse/''USERNAME''/conf
 
<!--T:11-->
where <code>''GROUPID''</code> is your group id and <code>''USERNAME''</code> is your user name. We will create a symbolic link from <code>${HOME}/gbrowse-config/</code> to this directory for your convenience. Files in this directory should be readable by all members of the group, so please do not change the group permission of files in this directory.
 
===Configuring the database connection=== <!--T:12-->
 
<!--T:13-->
If you use MySQL, you need the following in your GBrowse config files:
 
<!--T:14-->
[username_example_genome:database]
db_adaptor    =    Bio::DB::SeqFeature::Store
db_args      =    -adaptor DBI::mysql
-dsn ''DATABASE'';mysql_read_default_file=/home/''SHARED''/.my.cnf
 
<!--T:15-->
where <code>''DATABASE''</code> is the name of your database and <code>''SHARED''</code> is the shared account. The <code>.my.cnf</code> file is a text file that is created by our staff. It contains information required for the shared account to make a connection to MySQL.
 
<!--T:16-->
If you decide to use Postgres, you need the following in your GBrowse config files:
 
<!--T:17-->
[username_example_genome:database]
db_adaptor    = Bio::DB::SeqFeature::Store
db_args      =  -adaptor DBI::Pg
-dsn          =  dbi:Pg:dbname=''DATABASE''
                   
where <code>''DATABASE''</code> is the name of your database.
 
==Using GBrowse== <!--T:18-->
 
===Input files=== <!--T:19-->
 
<!--T:20-->
GBrowse is able to read .bam files directly. You do not need to upload them to the database in order to display them. If you want GBrowse to read these .bam files directly:
* Files need to be copied to your <code>/project</code> directory and they should be readable by the group.
* The directory that contains the .bam files must have the <tt>setgid</tt> and <tt>group-execute</tt> bits turned on; that is, the output of <code>ls –l</code> must show a small "s" in the group-execute field (not a large "S").
* Make sure that the .bam file's group ownership is set to your group and not to your username. For example, <code>jsmith:jsmith</code> is wrong, <code>jsmith:def-kjones</code> is right.
* Edit your config file to specify the path to the .bam file. Here is an example:
 
<!--T:21-->
[example_bam:database]
db_adaptor        = Bio::DB::Sam
db_args          = -bam /project/''GROUPID''/''USERNAME''/gbrowse_bam_files/example_file.bam
search options    = default
 
===Uploading files to the database=== <!--T:22-->
 
<!--T:23-->
This can be done using BioPerl. Here are commands that need to be run.
 
<!--T:24-->
module load bioperl/1.7.1
bp_seqfeature_load.pl -c –d ''DATABASE'':mysql_read_default_file=/home/''USERNAME''/.my.cnf \
    example_genomic_sequence.fa header_file
 
<!--T:25-->
In this example <code>''DATABASE''</code> is the name of your database and <code>example_genomic_sequence.fa</code> is the [https://en.wikipedia.org/wiki/FASTA_format FASTA file] containing the entire genome that you want to visualize with GBrowse. <code>header_file</code> contains details about the length of the chromosomes. Here is an example of a header file:
 
<!--T:26-->
<pre>
##sequence-region I 1 15072434
##sequence-region II 1 15279421
##sequence-region III 1 13783801
##sequence-region IV 1 17493829
##sequence-region V 1 20924180
##sequence-region X 1 17718942
##sequence-region MtDNA 1 13794
</pre>
 
<!--T:27-->
We remind you that the above commands should be run via the [[Running jobs|job scheduler]]. Do not run these on the head node!
 
<!--T:28-->
Once you uploaded your data to your database, you need to grant view access to the <code>''SHARED''</code> account so that GBrowse is able to access your database for reading. Please see [[Database servers#How_to_share_your_MySQL_data|How to share your MySQL data]].
 
 
</translate>

Latest revision as of 22:32, 22 June 2022

Other languages:

Introduction

GBrowse is a combination of database and interactive web pages for manipulating and displaying annotations on genomes. It requires a web interface to display. GBrowse is installed on Cedar. The web address of the installation is https://gateway.cedar.computecanada.ca.

The Cedar installation differs in some ways from the standard GBrowse setup described at the official website: http://gmod.org/wiki/GBrowse, particularly with regard to authentication and authorization.

Requesting access to GBrowse

In order for GBrowse to be able to access your files and directories, our staff will create a shared account for each research group that requests access to GBrowse. While using GBrowse, any member of a research group can read GBrowse config files and input files belonging to any other member of that group. If you wish to use GBrowse, the Principal Investigator (PI) of your group must agree to this change from the usual file security practices. Have the PI write to our technical support indicating that they want a GBrowse account to be created for the group, and that they understand the implications of a shared account.

You must also have a database account on Cedar. If you already have one, please give the name of the database in your email. If you do not already have a database account, please read Database servers carefully and answer the questions given there for setting up a database.

Setting up GBrowse

Config files

Since GBrowse needs to be able to read config files of all users within a group, place your GBrowse config files in the following directory:

/project/GROUPID/gbrowse/USERNAME/conf

where GROUPID is your group id and USERNAME is your user name. We will create a symbolic link from ${HOME}/gbrowse-config/ to this directory for your convenience. Files in this directory should be readable by all members of the group, so please do not change the group permission of files in this directory.

Configuring the database connection

If you use MySQL, you need the following in your GBrowse config files:

[username_example_genome:database]
db_adaptor    =     Bio::DB::SeqFeature::Store
db_args       =    -adaptor DBI::mysql
-dsn DATABASE;mysql_read_default_file=/home/SHARED/.my.cnf

where DATABASE is the name of your database and SHARED is the shared account. The .my.cnf file is a text file that is created by our staff. It contains information required for the shared account to make a connection to MySQL.

If you decide to use Postgres, you need the following in your GBrowse config files:

[username_example_genome:database]
db_adaptor    = Bio::DB::SeqFeature::Store
db_args       =  -adaptor DBI::Pg
-dsn          =  dbi:Pg:dbname=DATABASE
                    

where DATABASE is the name of your database.

Using GBrowse

Input files

GBrowse is able to read .bam files directly. You do not need to upload them to the database in order to display them. If you want GBrowse to read these .bam files directly:

  • Files need to be copied to your /project directory and they should be readable by the group.
  • The directory that contains the .bam files must have the setgid and group-execute bits turned on; that is, the output of ls –l must show a small "s" in the group-execute field (not a large "S").
  • Make sure that the .bam file's group ownership is set to your group and not to your username. For example, jsmith:jsmith is wrong, jsmith:def-kjones is right.
  • Edit your config file to specify the path to the .bam file. Here is an example:
[example_bam:database]
db_adaptor        = Bio::DB::Sam
db_args           = -bam /project/GROUPID/USERNAME/gbrowse_bam_files/example_file.bam
search options    = default

Uploading files to the database

This can be done using BioPerl. Here are commands that need to be run.

module load bioperl/1.7.1
bp_seqfeature_load.pl -c –d DATABASE:mysql_read_default_file=/home/USERNAME/.my.cnf \
   example_genomic_sequence.fa header_file

In this example DATABASE is the name of your database and example_genomic_sequence.fa is the FASTA file containing the entire genome that you want to visualize with GBrowse. header_file contains details about the length of the chromosomes. Here is an example of a header file:

##sequence-region I 1 15072434
##sequence-region II 1 15279421
##sequence-region III 1 13783801
##sequence-region IV 1 17493829
##sequence-region V 1 20924180
##sequence-region X 1 17718942
##sequence-region MtDNA 1 13794

We remind you that the above commands should be run via the job scheduler. Do not run these on the head node!

Once you uploaded your data to your database, you need to grant view access to the SHARED account so that GBrowse is able to access your database for reading. Please see How to share your MySQL data.